Apr 13 14:08:48 devstack cinder-volume[72910]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 14:08:48 devstack cinder-volume[72910]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 14:08:48 devstack cinder-volume[72910]: we strongly recommend against using it for new projects. Apr 13 14:08:48 devstack cinder-volume[72910]: If you are already using Eventlet, we recommend migrating to a different Apr 13 14:08:48 devstack cinder-volume[72910]: framework. For more detail see Apr 13 14:08:48 devstack cinder-volume[72910]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 14:08:48 devstack cinder-volume[72910]: import eventlet # noqa Apr 13 14:08:50 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:08:50 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:08:50 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:08:51 devstack cinder-volume[72910]: INFO dbcounter [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Registered counter for database cinder Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG dbcounter [-] [72910] Writer thread running {{(pid=72910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.rpc [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.rpc [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.volume.manager [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Determined volume DB was empty at startup. Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG cinder.volume.manager [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72910) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.volume.manager [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 14:08:51 devstack cinder-volume[72910]: WARNING stevedore.named [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 14:08:51 devstack cinder-volume[72910]: WARNING castellan.key_manager [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:08:51 devstack cinder-volume[72910]: WARNING cinder.keymgr.conf_key_mgr [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG cinder.volume.drivers.lvm [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72910) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_concurrency.processutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_concurrency.processutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] CMD "cinder-rtstool verify" returned: 0 in 0.230s {{(pid=72910) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.rpc [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.rpc [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 13 14:08:51 devstack cinder-volume[72910]: WARNING stevedore.named [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 14:08:51 devstack cinder-volume[72910]: WARNING castellan.key_manager [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:08:51 devstack cinder-volume[72910]: INFO cinder.volume.manager [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_db.sqlalchemy.engines [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:08:51 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Starting 1 workers Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Started child 73016 {{(pid=72910) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Full set of CONF: {{(pid=72910) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] ******************************************************************************** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Configuration options gathered from: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] ================================================================================ {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] allow_availability_zone_fallback = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] allow_compression_on_image_upload = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] allowed_direct_url_schemes = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] api_rate_limit = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] auth_strategy = keystone {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] az_cache_duration = 3600 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_availability_zone = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_host = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_stats_polling_interval = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backup_api_class = cinder.backup.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backup_name_template = backup-%s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backup_use_same_host = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backup_use_temp_snapshot = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] chap_password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] chap_username = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_internal_tenant_project_id = 5e6328e27bf4463590b76d189cb17b37 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_internal_tenant_user_id = 6c7e1f75d8ec41f89bd9a9e44cc0f636 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cloned_volume_same_az = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cluster = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] compression_format = gzip {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] compute_api_class = cinder.compute.nova.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] config_dir = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] config_source = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] control_exchange = openstack {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] debug = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] default_availability_zone = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] default_group_type = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] default_volume_type = lvmdriver-1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] disk_geometry = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] driver_client_cert = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] driver_client_cert_key = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] driver_data_namespace = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] driver_ssl_cert_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] driver_ssl_cert_verify = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] driver_use_ssl = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] enable_force_upload = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] enable_new_services = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] enable_unsupported_driver = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] enforce_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] filter_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_api_insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_api_servers = ['http://192.168.122.184/image'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_api_ssl_compression = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_ca_certificates_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_catalog_info = image:glance:publicURL {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_num_retries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance_request_timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] goodness_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] graceful_shutdown_timeout = 5 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] group_api_class = cinder.group.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] host = devstack {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_compress_on_upload = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_conversion_address_space_limit = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: INFO cinder.volume.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_conversion_cpu_limit = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_conversion_disable = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_upload_use_cinder_backend = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_upload_use_internal_tenant = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_volume_cache_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_volume_cache_max_count = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] image_volume_cache_max_size_gb = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] init_host_max_objects_retrieval = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] instance_format = [instance: %(uuid)s] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] iscsi_target_flags = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] iscsi_write_cache = on {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] iser_helper = tgtadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] iser_ip_address = 192.168.122.184 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] iser_port = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_color = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_config_append = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_dir = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_options = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_rotate_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_rotate_interval_type = days {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] log_rotation_type = none {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] max_age = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] max_logfile_count = 30 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] max_logfile_size_mb = 200 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] max_over_subscription_ratio = 20.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] message_reap_interval = 86400 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] message_ttl = 2592000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] migration_create_volume_timeout_secs = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] monkey_patch = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] monkey_patch_modules = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] my_ip = 192.168.122.184 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] no_snapshot_gb_quota = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] num_iser_scan_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] num_shell_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] num_volume_device_scan_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] nvmeof_conn_info_version = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] nvmet_ns_id = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] nvmet_port_id = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_max_limit = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_volume_ext_list = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_volume_listen_port = 8776 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_volume_use_ssl = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] osapi_volume_workers = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] per_volume_size_limit = -1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] periodic_fuzzy_delay = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] periodic_interval = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] public_endpoint = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] publish_errors = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_backup_gigabytes = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_backups = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_gigabytes = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_groups = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_snapshots = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] quota_volumes = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] rate_limit_burst = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] rate_limit_except_level = CRITICAL {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] rate_limit_interval = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] reinit_driver_count = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] replication_device = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] report_discard_supported = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] report_interval = 120 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] reservation_clean_interval = 86400 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] reservation_expire = 86400 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] reserved_image_namespaces = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] reserved_percentage = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] rpc_response_timeout = 120 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] run_external_periodic_tasks = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] scst_target_driver = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] scst_target_iqn_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_down_time = 720 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] shell_completion = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] snapshot_name_template = snapshot-%s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] snapshot_same_host = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] split_loggers = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] state_path = /opt/stack/data/cinder {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] storage_availability_zone = nova {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] storage_protocol = iSCSI {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] syslog_log_facility = LOG_USER {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] target_helper = lioadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] target_ip_address = 192.168.122.184 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] target_port = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] target_protocol = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] target_secondary_ip_addresses = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] trace_flags = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] transport_url = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] until_refresh = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_chap_auth = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_default_quota_class = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_journal = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_json = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_stderr = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] use_syslog = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] verify_glance_signatures = enabled {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_api_class = cinder.volume.api.API {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_backend_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_clear = zero {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_clear_ionice = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_clear_size = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_copy_bps_limit = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_dd_blocksize = 1M {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:51 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_name_template = volume-%s {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_service_inithost_offload = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volume_usage_audit_period = month {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] zoning_mode = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_concurrency.disable_process_locking = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.admin_password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.admin_token = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.admin_user = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_port = 35357 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_protocol = https {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_section = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_type = password {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_uri = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.auth_version = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.cache = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.identity_uri = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.include_service_catalog = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack sudo[73022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.interface = public {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack sudo[73022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_password = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcache_username = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.region_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.service_type = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.184/identity {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.backend = dogpile.cache.null {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.backend_argument = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.backend_expiration_time = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.config_prefix = cache.oslo {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.debug_cache_backend = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.enable_retry_client = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.enable_socket_keepalive = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.enforce_fips_mode = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.expiration_time = 600 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.hashclient_retry_attempts = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_dead_retry = 300 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_pool_maxsize = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_sasl_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.proxies = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.redis_db = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.redis_server = localhost:6379 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.retry_attempts = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.retry_delay = 0.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.socket_keepalive_count = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.socket_keepalive_idle = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.socket_keepalive_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.socket_timeout = 1.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.tls_allowed_ciphers = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.tls_cafile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.tls_certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.tls_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.tls_keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cache.username = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] coordination.backend_url = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.asyncio_connection = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.asyncio_slave_connection = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.backend = sqlalchemy {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.connection = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.connection_debug = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.connection_parameters = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.connection_recycle_time = 3600 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.connection_trace = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.db_inc_retry_interval = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.db_max_retries = 20 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.db_max_retry_interval = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.db_retry_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.max_overflow = 50 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.max_pool_size = 5 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.max_retries = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.mysql_wsrep_sync_wait = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.pool_timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.retry_interval = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.slave_connection = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.sqlite_synchronous = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.synchronous_reader = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] database.use_db_reconnect = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.connection_string = messaging:// {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.es_doc_type = notification {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.es_scroll_size = 10000 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.es_scroll_time = 2m {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.filter_error_trace = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.hmac_keys = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.sentinel_service_name = mymaster {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.socket_timeout = 0.1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.trace_requests = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler.trace_sqlalchemy = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler_jaeger.process_tags = {} {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler_jaeger.service_name_prefix = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] profiler_otlp.service_name_prefix = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.enforce_new_defaults = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: WARNING oslo_config.cfg [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.enforce_scope = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.policy_default_rule = default {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.policy_file = policy.yaml {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.group = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.helper_command = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] privsep_osbrick.user = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.group = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.helper_command = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] cinder_sys_admin.user = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.auth_section = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.auth_type = password {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.cafile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.collect_timing = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.send_service_user_token = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.split_loggers = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] service_user.timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.auth_section = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.auth_type = password {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.collect_timing = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.region_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.split_loggers = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] glance.timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.backend_availability_zone = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.chap_password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.chap_username = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.disk_geometry = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.driver_client_cert = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.driver_client_cert_key = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.driver_data_namespace = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.driver_use_ssl = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.extra_capabilities = {} {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.filter_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.goodness_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.iscsi_target_flags = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.iscsi_write_cache = on {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.iser_helper = tgtadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.iser_ip_address = 192.168.122.184 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.iser_port = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.lvm_share_target = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.lvm_type = auto {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.num_shell_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.replication_device = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.report_discard_supported = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.reserved_percentage = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.target_helper = tgtadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.target_ip_address = 192.168.122.184 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.target_port = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.target_protocol = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.trace_flags = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.unique_fqdn_network = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.use_chap_auth = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_backend_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_clear = zero {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_clear_ionice = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_clear_size = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_reports.file_event_handler = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_reports.log_dir = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.backend_host = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.chap_password = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.chap_username = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.disk_geometry = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.driver_client_cert = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.extra_capabilities = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.filter_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.goodness_function = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.iser_helper = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.iser_ip_address = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.iser_port = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.lvm_share_target = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.lvm_type = auto {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.num_shell_tries = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.replication_device = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.report_discard_supported = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.reserved_percentage = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.scst_target_driver = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.storage_protocol = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.target_helper = lioadm {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.target_ip_address = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.target_port = 3260 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.trace_flags = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.use_chap_auth = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_clear = zero {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_clear_size = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] lvmdriver-1.volumes_dir = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.ssl = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:51 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_notifications.driver = [] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_notifications.retry = -1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] key_manager.fixed_key = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.barbican_api_version = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.barbican_endpoint = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.barbican_endpoint_type = public {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.barbican_region_name = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.cafile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.collect_timing = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.number_of_retries = 60 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.retry_delay = 1 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.send_service_user_token = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.split_loggers = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.verify_ssl = True {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican.verify_ssl_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.auth_section = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.auth_type = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.cafile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.certfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.collect_timing = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.insecure = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.keyfile = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.split_loggers = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] barbican_service_user.timeout = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.approle_role_id = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.approle_secret_id = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.kv_mountpoint = secret {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.kv_path = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.kv_version = 2 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.namespace = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.root_token_id = **** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.ssl_ca_crt_file = None {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.timeout = 60.0 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.use_ssl = False {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:08:52 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] ******************************************************************************** {{(pid=72910) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 14:08:52 devstack sudo[73022]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:52 devstack sudo[73055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:52 devstack sudo[73055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:52 devstack sudo[73055]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.514s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:08:52 devstack cinder-volume[73016]: INFO cinder.brick.local_dev.lvm [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:52 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:52 devstack sudo[73302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:08:52 devstack sudo[73302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:53 devstack sudo[73302]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:53 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:53 devstack cinder-volume[73016]: DEBUG cinder.brick.local_dev.lvm [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73016) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 13 14:08:53 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:53 devstack sudo[73517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:53 devstack sudo[73517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:54 devstack sudo[73517]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:54 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.087s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:54 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:54 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:54 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:54 devstack sudo[73712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:54 devstack sudo[73712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:55 devstack sudo[73712]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:55 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:55 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:55 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:55 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:55 devstack sudo[73716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 13 14:08:55 devstack sudo[73716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:55 devstack sudo[73716]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:55 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.469s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:55 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:55 devstack sudo[73719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:08:55 devstack sudo[73719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:56 devstack sudo[73719]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:56 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:56 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:56 devstack sudo[73727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:08:56 devstack sudo[73727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:56 devstack sudo[73727]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:56 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:56 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:56 devstack sudo[73730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:08:56 devstack sudo[73730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:56 devstack sudo[73730]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:56 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:56 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:56 devstack sudo[73735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:56 devstack sudo[73735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:57 devstack sudo[73735]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:57 devstack sudo[73739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:57 devstack sudo[73739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:57 devstack sudo[73739]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:57 devstack cinder-volume[73016]: INFO cinder.volume.drivers.lvm [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:57 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:57 devstack sudo[73752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:57 devstack sudo[73752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:58 devstack sudo[73752]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:58 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:58 devstack cinder-volume[73016]: DEBUG cinder.volume.drivers.lvm [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Updating volume stats {{(pid=73016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 14:08:58 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:58 devstack sudo[73866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:08:58 devstack sudo[73866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:58 devstack sudo[73866]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:58 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:58 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:58 devstack sudo[73987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:08:58 devstack sudo[73987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:59 devstack sudo[73987]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:59 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:59 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:59 devstack sudo[74008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:08:59 devstack sudo[74008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:08:59 devstack sudo[74008]: pam_unix(sudo:session): session closed for user root Apr 13 14:08:59 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.415s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:08:59 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:08:59 devstack sudo[74011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:08:59 devstack sudo[74011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:00 devstack sudo[74011]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:00 devstack cinder-volume[73016]: INFO cinder.volume.driver [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Driver hasn't implemented _init_vendor_properties() Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG cinder.volume.driver [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73016) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_db.sqlalchemy.engines [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG dbcounter [-] [73016] Writer thread running {{(pid=73016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG cinder.db.sqlalchemy.api [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Building query based on filter {{(pid=73016) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG cinder.image.image_utils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73016) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 14:09:00 devstack cinder-volume[73016]: INFO cinder.keymgr.migration [None req-52db8bb2-d435-43ce-9949-023480e01b88 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG cinder.volume.drivers.lvm [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Updating volume stats {{(pid=73016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:00 devstack sudo[74019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:09:00 devstack sudo[74019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:00 devstack sudo[74019]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:00 devstack sudo[74022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:09:00 devstack sudo[74022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:00 devstack sudo[74022]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:00 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:01 devstack sudo[74025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:09:01 devstack sudo[74025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:01 devstack sudo[74025]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:01 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:01 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:01 devstack sudo[74030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:09:01 devstack sudo[74030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:01 devstack cinder-volume[72910]: DEBUG dbcounter [-] [72910] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72910) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:09:01 devstack sudo[74030]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:01 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.525s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:01 devstack cinder-volume[73016]: DEBUG cinder.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Notifying Schedulers of capabilities ... {{(pid=73016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:09:02 devstack cinder-volume[73016]: INFO cinder.volume.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Driver initialization completed successfully. Apr 13 14:09:02 devstack cinder-volume[73016]: INFO cinder.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Initiating service 2 cleanup Apr 13 14:09:02 devstack cinder-volume[73016]: INFO cinder.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Service 2 cleanup completed. Apr 13 14:09:02 devstack cinder-volume[73016]: DEBUG cinder.service [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Creating RPC server for service cinder-volume {{(pid=73016) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 14:09:02 devstack cinder-volume[73016]: DEBUG cinder.service [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73016) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 14:09:02 devstack cinder-volume[73016]: INFO cinder.volume.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 13 14:09:02 devstack cinder-volume[73016]: DEBUG cinder.volume.drivers.lvm [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Updating volume stats {{(pid=73016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 14:09:02 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:02 devstack sudo[74039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:09:02 devstack sudo[74039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:02 devstack sudo[74039]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:02 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:02 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:02 devstack sudo[74042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:09:02 devstack sudo[74042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:03 devstack sudo[74042]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:03 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:03 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:03 devstack sudo[74099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:09:03 devstack sudo[74099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:03 devstack sudo[74099]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:03 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:03 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:09:03 devstack sudo[74103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:09:03 devstack sudo[74103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:09:03 devstack sudo[74103]: pam_unix(sudo:session): session closed for user root Apr 13 14:09:03 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:09:03 devstack cinder-volume[73016]: INFO cinder.volume.manager [None req-558a4d07-e383-4a0b-ba6c-737b1e55b6bb None None] Driver post RPC initialization completed successfully. Apr 13 14:09:12 devstack cinder-volume[73016]: DEBUG dbcounter [-] [73016] Writing DB stats cinder:SELECT=3 {{(pid=73016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:09:13 devstack cinder-volume[73016]: DEBUG dbcounter [-] [73016] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:10:26 devstack cinder-volume[73016]: DEBUG oslo_service.periodic_task [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73016) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:10:26 devstack cinder-volume[73016]: DEBUG cinder.volume.drivers.lvm [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Updating volume stats {{(pid=73016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 14:10:26 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:10:26 devstack sudo[78994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:10:26 devstack sudo[78994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:10:27 devstack sudo[78994]: pam_unix(sudo:session): session closed for user root Apr 13 14:10:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:10:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:10:27 devstack sudo[79002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:10:27 devstack sudo[79002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:10:27 devstack sudo[79002]: pam_unix(sudo:session): session closed for user root Apr 13 14:10:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:10:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:10:27 devstack sudo[79007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:10:27 devstack sudo[79007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:10:28 devstack sudo[79007]: pam_unix(sudo:session): session closed for user root Apr 13 14:10:28 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:10:28 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:10:28 devstack sudo[79014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:10:28 devstack sudo[79014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:10:28 devstack sudo[79014]: pam_unix(sudo:session): session closed for user root Apr 13 14:10:28 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:10:28 devstack cinder-volume[73016]: DEBUG cinder.manager [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Notifying Schedulers of capabilities ... {{(pid=73016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:11:13 devstack cinder-volume[73016]: DEBUG dbcounter [-] [73016] Writing DB stats cinder:SELECT=1 {{(pid=73016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:11:13 devstack cinder-volume[73016]: DEBUG dbcounter [-] [73016] Writing DB stats cinder:UPDATE=1 {{(pid=73016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:11:26 devstack cinder-volume[73016]: DEBUG oslo_service.periodic_task [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73016) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:11:26 devstack cinder-volume[73016]: DEBUG cinder.volume.drivers.lvm [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Updating volume stats {{(pid=73016) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 14:11:26 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:11:26 devstack sudo[80875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 14:11:26 devstack sudo[80875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:11:27 devstack sudo[80875]: pam_unix(sudo:session): session closed for user root Apr 13 14:11:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:11:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:11:27 devstack sudo[80899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:11:27 devstack sudo[80899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:11:27 devstack sudo[80899]: pam_unix(sudo:session): session closed for user root Apr 13 14:11:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:11:27 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:11:27 devstack sudo[80922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 14:11:27 devstack sudo[80922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:11:28 devstack sudo[80922]: pam_unix(sudo:session): session closed for user root Apr 13 14:11:28 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:11:28 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:11:28 devstack sudo[80931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 14:11:28 devstack sudo[80931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:11:28 devstack sudo[80931]: pam_unix(sudo:session): session closed for user root Apr 13 14:11:28 devstack cinder-volume[73016]: DEBUG oslo_concurrency.processutils [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:11:28 devstack cinder-volume[73016]: DEBUG cinder.manager [None req-28079975-1779-4bdc-a3df-f007aff790e6 None None] Notifying Schedulers of capabilities ... {{(pid=73016) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:12:22 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Caught SIGTERM, stopping children Apr 13 14:12:22 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Acquiring lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:12:22 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Acquired lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:12:22 devstack cinder-volume[72910]: DEBUG oslo_concurrency.lockutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Releasing lock "singleton_lock" {{(pid=72910) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:12:22 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Stop services. {{(pid=72910) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 14:12:22 devstack cinder-volume[72910]: DEBUG oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Killing children. {{(pid=72910) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 14:12:22 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Waiting on 1 children to exit Apr 13 14:12:22 devstack cinder-volume[73016]: DEBUG oslo_concurrency.lockutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Acquiring lock "singleton_lock" {{(pid=73016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:12:22 devstack cinder-volume[73016]: DEBUG oslo_concurrency.lockutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Acquired lock "singleton_lock" {{(pid=73016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:12:22 devstack cinder-volume[73016]: DEBUG oslo_concurrency.lockutils [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Releasing lock "singleton_lock" {{(pid=73016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:12:22 devstack cinder-volume[73016]: WARNING amqp [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 14:12:22 devstack cinder-volume[73016]: WARNING amqp [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 14:12:22 devstack cinder-volume[72910]: INFO oslo_service.backend._eventlet.service [None req-adf6733d-9167-4b7e-b580-0e6697775330 None None] Child 73016 exited with status 0 Apr 13 14:12:22 devstack cinder-volume[82060]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 14:12:22 devstack cinder-volume[82060]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 14:12:22 devstack cinder-volume[82060]: we strongly recommend against using it for new projects. Apr 13 14:12:22 devstack cinder-volume[82060]: If you are already using Eventlet, we recommend migrating to a different Apr 13 14:12:22 devstack cinder-volume[82060]: framework. For more detail see Apr 13 14:12:22 devstack cinder-volume[82060]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 14:12:22 devstack cinder-volume[82060]: import eventlet # noqa Apr 13 14:12:24 devstack cinder-volume[82060]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:12:24 devstack cinder-volume[82060]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:12:24 devstack cinder-volume[82060]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:12:24 devstack cinder-volume[82060]: INFO dbcounter [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Registered counter for database cinder Apr 13 14:12:24 devstack cinder-volume[82060]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG dbcounter [-] [82060] Writer thread running {{(pid=82060) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 14:12:25 devstack cinder-volume[82060]: INFO cinder.rpc [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 14:12:25 devstack cinder-volume[82060]: INFO cinder.rpc [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:25 devstack cinder-volume[82060]: INFO cinder.volume.manager [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Determined volume DB was empty at startup. Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG cinder.volume.manager [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82060) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 14:12:25 devstack cinder-volume[82060]: INFO cinder.volume.manager [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 14:12:25 devstack cinder-volume[82060]: WARNING stevedore.named [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 14:12:25 devstack cinder-volume[82060]: WARNING castellan.key_manager [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:12:25 devstack cinder-volume[82060]: WARNING cinder.keymgr.conf_key_mgr [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:12:25 devstack cinder-volume[82060]: INFO cinder.volume.manager [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_db.sqlalchemy.engines [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:25 devstack cinder-volume[82060]: INFO oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Starting 1 workers Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Started child 82179 {{(pid=82060) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Full set of CONF: {{(pid=82060) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] ******************************************************************************** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Configuration options gathered from: {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] ================================================================================ {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] allow_availability_zone_fallback = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] allow_compression_on_image_upload = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] allowed_direct_url_schemes = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] api_rate_limit = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82179]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] auth_strategy = keystone {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_availability_zone = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_host = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_stats_polling_interval = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backup_api_class = cinder.backup.api.API {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backup_name_template = backup-%s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backup_use_same_host = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backup_use_temp_snapshot = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] chap_password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] chap_username = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_internal_tenant_project_id = 5e6328e27bf4463590b76d189cb17b37 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_internal_tenant_user_id = 6c7e1f75d8ec41f89bd9a9e44cc0f636 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cluster = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] compression_format = gzip {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] compute_api_class = cinder.compute.nova.API {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] config_dir = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] config_source = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] control_exchange = openstack {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] debug = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] default_availability_zone = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] default_group_type = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] default_volume_type = QuobyteHD {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] disk_geometry = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] driver_client_cert = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] driver_client_cert_key = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] driver_data_namespace = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] driver_ssl_cert_path = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] driver_ssl_cert_verify = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] driver_use_ssl = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] enable_new_services = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] enable_unsupported_driver = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] enabled_backends = ['QuobyteHD'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] enforce_multipath_for_image_xfer = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] filter_function = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_api_insecure = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_api_servers = ['http://192.168.122.184/image'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_api_ssl_compression = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_ca_certificates_file = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_catalog_info = image:glance:publicURL {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_num_retries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance_request_timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] goodness_function = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] graceful_shutdown_timeout = 5 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] group_api_class = cinder.group.api.API {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] host = devstack {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_compress_on_upload = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_conversion_address_space_limit = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_conversion_cpu_limit = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_conversion_disable = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_upload_use_cinder_backend = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_upload_use_internal_tenant = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_volume_cache_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_volume_cache_max_count = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] image_volume_cache_max_size_gb = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] init_host_max_objects_retrieval = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] instance_format = [instance: %(uuid)s] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] iscsi_target_flags = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] iscsi_write_cache = on {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] iser_helper = tgtadm {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] iser_ip_address = 192.168.122.184 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] iser_port = 3260 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_color = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_config_append = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_dir = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_file = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_options = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_rotate_interval = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_rotate_interval_type = days {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] log_rotation_type = none {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] max_age = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] max_logfile_count = 30 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] max_logfile_size_mb = 200 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] max_over_subscription_ratio = 20.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] message_reap_interval = 86400 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] message_ttl = 2592000 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] migration_create_volume_timeout_secs = 300 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] monkey_patch = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] monkey_patch_modules = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] my_ip = 192.168.122.184 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] no_snapshot_gb_quota = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] num_iser_scan_tries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82179]: INFO cinder.volume.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] num_shell_tries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.remotefs [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82179) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] num_volume_device_scan_tries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] nvmeof_conn_info_version = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] nvmet_ns_id = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] nvmet_port_id = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_max_limit = 1000 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_volume_ext_list = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_volume_listen_port = 8776 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_volume_use_ssl = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] osapi_volume_workers = 2 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] per_volume_size_limit = -1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] periodic_fuzzy_delay = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] periodic_interval = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] public_endpoint = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] publish_errors = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_backup_gigabytes = 1000 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_backups = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_gigabytes = 1000 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_groups = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_snapshots = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] quota_volumes = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] rate_limit_burst = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] rate_limit_except_level = CRITICAL {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] rate_limit_interval = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] reinit_driver_count = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] replication_device = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] report_discard_supported = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] report_interval = 120 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] reservation_clean_interval = 86400 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] reservation_expire = 86400 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] reserved_image_namespaces = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] reserved_percentage = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] rpc_response_timeout = 120 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] run_external_periodic_tasks = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] scst_target_driver = iscsi {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] scst_target_iqn_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_down_time = 720 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] shell_completion = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] snapshot_name_template = snapshot-%s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] split_loggers = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] state_path = /opt/stack/data/cinder {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] storage_availability_zone = nova {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] storage_protocol = iSCSI {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] syslog_log_facility = LOG_USER {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] target_helper = lioadm {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] target_ip_address = 192.168.122.184 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] target_port = 3260 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] target_protocol = iscsi {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] target_secondary_ip_addresses = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] trace_flags = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] transport_url = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] until_refresh = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_chap_auth = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_default_quota_class = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_journal = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_json = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_multipath_for_image_xfer = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_stderr = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] use_syslog = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] verify_glance_signatures = enabled {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_api_class = cinder.volume.api.API {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_backend_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_clear = zero {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_clear_ionice = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_clear_size = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_copy_bps_limit = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_dd_blocksize = 1M {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_name_template = volume-%s {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_service_inithost_offload = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volume_usage_audit_period = month {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] zoning_mode = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_concurrency.disable_process_locking = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.admin_password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.admin_token = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.admin_user = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_port = 35357 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_protocol = https {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_section = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_type = password {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_uri = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.auth_version = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.cache = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.identity_uri = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.include_service_catalog = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.insecure = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.interface = public {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_password = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcache_username = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.region_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.service_type = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.184/identity {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.backend = dogpile.cache.null {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.backend_argument = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.backend_expiration_time = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.config_prefix = cache.oslo {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.debug_cache_backend = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.enable_retry_client = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.enable_socket_keepalive = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.enforce_fips_mode = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.expiration_time = 600 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.hashclient_retry_attempts = 2 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_dead_retry = 300 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_pool_maxsize = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_sasl_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.proxies = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.redis_db = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.redis_server = localhost:6379 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.retry_attempts = 2 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.retry_delay = 0.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.socket_keepalive_count = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.socket_keepalive_idle = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.socket_keepalive_interval = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.socket_timeout = 1.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.tls_allowed_ciphers = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.tls_cafile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.tls_certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.tls_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.tls_keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cache.username = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] coordination.backend_url = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.asyncio_connection = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.asyncio_slave_connection = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.backend = sqlalchemy {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.connection = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.connection_debug = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.connection_parameters = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.connection_recycle_time = 3600 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.connection_trace = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.db_inc_retry_interval = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.db_max_retries = 20 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.db_max_retry_interval = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.db_retry_interval = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.max_overflow = 50 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.max_pool_size = 5 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.max_retries = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.mysql_wsrep_sync_wait = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.pool_timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.retry_interval = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.slave_connection = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.sqlite_synchronous = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.synchronous_reader = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] database.use_db_reconnect = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82179) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.connection_string = messaging:// {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.es_doc_type = notification {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.es_scroll_size = 10000 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.es_scroll_time = 2m {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.filter_error_trace = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.hmac_keys = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.sentinel_service_name = mymaster {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82179]: WARNING cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.socket_timeout = 0.1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82179]: WARNING cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.trace_requests = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler.trace_sqlalchemy = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler_jaeger.process_tags = {} {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler_jaeger.service_name_prefix = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] profiler_otlp.service_name_prefix = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Running cmd (subprocess): mount.quobyte {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.enforce_new_defaults = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: WARNING oslo_config.cfg [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.enforce_scope = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.policy_default_rule = default {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.policy_file = policy.yaml {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.group = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.helper_command = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] privsep_osbrick.user = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.group = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.helper_command = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] cinder_sys_admin.user = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.auth_section = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.auth_type = password {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.cafile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.collect_timing = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.insecure = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.send_service_user_token = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.split_loggers = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] service_user.timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.auth_section = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.auth_type = password {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.collect_timing = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.insecure = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.region_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.split_loggers = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] glance.timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.backend_availability_zone = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.chap_password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.chap_username = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.disk_geometry = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.driver_client_cert = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.driver_client_cert_key = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.driver_data_namespace = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.driver_use_ssl = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.extra_capabilities = {} {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.filter_function = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.goodness_function = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.iscsi_target_flags = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.iscsi_write_cache = on {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.iser_helper = tgtadm {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.iser_ip_address = 192.168.122.184 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.iser_port = 3260 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_host = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_login = admin {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_mount_options = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_private_key = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_share_path = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.num_shell_tries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.quobyte_volume_url = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.replication_device = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.report_discard_supported = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.reserved_percentage = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.target_helper = tgtadm {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.target_ip_address = 192.168.122.184 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.target_port = 3260 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.target_protocol = iscsi {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.trace_flags = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.unique_fqdn_network = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.use_chap_auth = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_backend_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_clear = zero {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_clear_ionice = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_clear_size = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_reports.file_event_handler = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_reports.log_dir = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.backend_availability_zone = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.backend_host = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.chap_password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.chap_username = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.chiscsi_conf = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.disk_geometry = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.driver_client_cert = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.driver_data_namespace = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.driver_use_ssl = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.extra_capabilities = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.filter_function = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.goodness_function = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.iser_helper = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.iser_ip_address = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.iser_port = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.iser_target_prefix = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_host = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_login = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_mount_options = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_password = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_private_key = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_share_path = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_ssh_port = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.num_shell_tries = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.nvmet_port_id = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.replication_device = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.report_discard_supported = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.reserved_percentage = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.scst_target_driver = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.storage_protocol = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.target_helper = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.target_ip_address = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.target_port = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.target_prefix = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.target_protocol = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.trace_flags = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.use_chap_auth = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_clear = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_clear_size = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] QuobyteHD.volumes_dir = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.ssl = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_notifications.driver = [] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_notifications.retry = -1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] key_manager.fixed_key = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.barbican_api_version = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.barbican_endpoint = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.barbican_endpoint_type = public {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.barbican_region_name = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.cafile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.collect_timing = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.insecure = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.number_of_retries = 60 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.retry_delay = 1 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.send_service_user_token = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.split_loggers = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.verify_ssl = True {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican.verify_ssl_path = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.auth_section = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.auth_type = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.cafile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.certfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.collect_timing = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.insecure = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.keyfile = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.split_loggers = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] barbican_service_user.timeout = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.approle_role_id = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.approle_secret_id = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.kv_mountpoint = secret {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.kv_path = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.kv_version = 2 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.namespace = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.root_token_id = **** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.ssl_ca_crt_file = None {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.timeout = 60.0 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.use_ssl = False {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:25 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] ******************************************************************************** {{(pid=82060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 14:12:25 devstack quobyte-client[82180]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 14:12:25 devstack quobyte-client[82180]: Invalid parameters found, error: missing mount point. Apr 13 14:12:25 devstack quobyte-client[82180]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 14:12:25 devstack quobyte-client[82180]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:25 devstack cinder-volume[82179]: INFO cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 ... Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 -c /etc/quobyte/client-cinder.cfg {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:25 devstack sudo[82181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 -c /etc/quobyte/client-cinder.cfg Apr 13 14:12:25 devstack sudo[82181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:25 devstack sudo[82181]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.525s {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:25 devstack cinder-volume[82179]: INFO cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 succeeded Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.531s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:25 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:25 devstack sudo[82250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:25 devstack sudo[82250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:26 devstack sudo[82250]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.420s {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:26 devstack cinder-volume[82179]: INFO cinder.volume.driver [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Driver hasn't implemented _init_vendor_properties() Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.volume.driver [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82179) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_db.sqlalchemy.engines [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG dbcounter [-] [82179] Writer thread running {{(pid=82179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.db.sqlalchemy.api [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Building query based on filter {{(pid=82179) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.image.image_utils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82179) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 14:12:26 devstack cinder-volume[82179]: INFO cinder.keymgr.migration [None req-0b3dbe1d-6b41-4530-85ea-8d38048f566e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:26 devstack sudo[82253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:26 devstack sudo[82253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:26 devstack sudo[82253]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.413s {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Notifying Schedulers of capabilities ... {{(pid=82179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:12:26 devstack cinder-volume[82179]: INFO cinder.volume.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Driver initialization completed successfully. Apr 13 14:12:26 devstack cinder-volume[82179]: INFO cinder.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Initiating service 3 cleanup Apr 13 14:12:26 devstack cinder-volume[82179]: INFO cinder.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Service 3 cleanup completed. Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.service [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Creating RPC server for service cinder-volume {{(pid=82179) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.service [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82179) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 14:12:26 devstack cinder-volume[82179]: INFO cinder.volume.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:26 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:26 devstack sudo[82259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:26 devstack sudo[82259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:27 devstack sudo[82259]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:27 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.445s {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:27 devstack cinder-volume[82179]: INFO cinder.volume.manager [None req-d9c619ea-0598-40b7-8b5a-9eb31cabf26b None None] Driver post RPC initialization completed successfully. Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG cinder.volume.drivers.quobyte [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82179) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:30 devstack sudo[82326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:30 devstack sudo[82326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:30 devstack sudo[82326]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG oslo_concurrency.processutils [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.416s {{(pid=82179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:30 devstack cinder-volume[82179]: DEBUG cinder.manager [None req-deb2b300-af65-4c44-8626-bc7c67c07b86 None None] Notifying Schedulers of capabilities ... {{(pid=82179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:12:34 devstack cinder-volume[82060]: INFO oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Caught SIGTERM, stopping children Apr 13 14:12:34 devstack cinder-volume[82060]: DEBUG oslo_concurrency.lockutils [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Acquiring lock "singleton_lock" {{(pid=82060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:12:34 devstack cinder-volume[82060]: DEBUG oslo_concurrency.lockutils [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Acquired lock "singleton_lock" {{(pid=82060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:12:34 devstack cinder-volume[82060]: DEBUG oslo_concurrency.lockutils [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Releasing lock "singleton_lock" {{(pid=82060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:12:34 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Stop services. {{(pid=82060) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 14:12:34 devstack cinder-volume[82060]: DEBUG oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Killing children. {{(pid=82060) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 14:12:34 devstack cinder-volume[82060]: INFO oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Waiting on 1 children to exit Apr 13 14:12:35 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Acquiring lock "singleton_lock" {{(pid=82179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:12:35 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Acquired lock "singleton_lock" {{(pid=82179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:12:35 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Releasing lock "singleton_lock" {{(pid=82179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:12:35 devstack cinder-volume[82179]: WARNING amqp [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 14:12:35 devstack cinder-volume[82179]: WARNING amqp [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 14:12:35 devstack cinder-volume[82060]: INFO oslo_service.backend._eventlet.service [None req-b2f6016a-d178-4b92-9533-2596a0bfea56 None None] Child 82179 exited with status 0 Apr 13 14:12:35 devstack cinder-volume[82404]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 14:12:35 devstack cinder-volume[82404]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 14:12:35 devstack cinder-volume[82404]: we strongly recommend against using it for new projects. Apr 13 14:12:35 devstack cinder-volume[82404]: If you are already using Eventlet, we recommend migrating to a different Apr 13 14:12:35 devstack cinder-volume[82404]: framework. For more detail see Apr 13 14:12:35 devstack cinder-volume[82404]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 14:12:35 devstack cinder-volume[82404]: import eventlet # noqa Apr 13 14:12:37 devstack cinder-volume[82404]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 14:12:37 devstack cinder-volume[82404]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 14:12:37 devstack cinder-volume[82404]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 14:12:37 devstack cinder-volume[82404]: INFO dbcounter [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Registered counter for database cinder Apr 13 14:12:37 devstack cinder-volume[82404]: DEBUG oslo_db.sqlalchemy.engines [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG dbcounter [-] [82404] Writer thread running {{(pid=82404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 14:12:38 devstack cinder-volume[82404]: INFO cinder.rpc [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 14:12:38 devstack cinder-volume[82404]: INFO cinder.rpc [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_db.sqlalchemy.engines [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:38 devstack cinder-volume[82404]: INFO cinder.volume.manager [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Determined volume DB was empty at startup. Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG cinder.volume.manager [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82404) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 14:12:38 devstack cinder-volume[82404]: WARNING stevedore.named [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 14:12:38 devstack cinder-volume[82404]: WARNING castellan.key_manager [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:12:38 devstack cinder-volume[82404]: WARNING cinder.keymgr.conf_key_mgr [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 14:12:38 devstack cinder-volume[82404]: INFO cinder.volume.manager [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_db.sqlalchemy.engines [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:38 devstack cinder-volume[82404]: INFO oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Starting 1 workers Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Started child 82621 {{(pid=82404) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Full set of CONF: {{(pid=82404) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] ******************************************************************************** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Configuration options gathered from: {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] ================================================================================ {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] allow_availability_zone_fallback = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] allow_compression_on_image_upload = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] allowed_direct_url_schemes = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] api_rate_limit = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] auth_strategy = keystone {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_availability_zone = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_host = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_stats_polling_interval = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backup_api_class = cinder.backup.api.API {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backup_name_template = backup-%s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backup_use_same_host = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backup_use_temp_snapshot = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] chap_password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] chap_username = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_internal_tenant_project_id = 5e6328e27bf4463590b76d189cb17b37 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_internal_tenant_user_id = 6c7e1f75d8ec41f89bd9a9e44cc0f636 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cluster = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] compression_format = gzip {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] compute_api_class = cinder.compute.nova.API {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] config_dir = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] config_source = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] control_exchange = openstack {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] debug = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] default_availability_zone = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] default_group_type = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] default_volume_type = QuobyteHD {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] disk_geometry = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] driver_client_cert = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] driver_client_cert_key = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] driver_data_namespace = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] driver_ssl_cert_path = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] driver_ssl_cert_verify = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] driver_use_ssl = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] enable_new_services = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] enable_unsupported_driver = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] enabled_backends = ['QuobyteHD'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] enforce_multipath_for_image_xfer = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] filter_function = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_api_insecure = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_api_servers = ['http://192.168.122.184/image'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_api_ssl_compression = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_ca_certificates_file = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_catalog_info = image:glance:publicURL {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82621]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_num_retries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance_request_timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] goodness_function = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] graceful_shutdown_timeout = 5 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] group_api_class = cinder.group.api.API {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] host = devstack {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_compress_on_upload = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_conversion_address_space_limit = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_conversion_cpu_limit = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_conversion_disable = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_upload_use_cinder_backend = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_upload_use_internal_tenant = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_volume_cache_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_volume_cache_max_count = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] image_volume_cache_max_size_gb = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] init_host_max_objects_retrieval = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] instance_format = [instance: %(uuid)s] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] iscsi_target_flags = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] iscsi_write_cache = on {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] iser_helper = tgtadm {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] iser_ip_address = 192.168.122.184 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] iser_port = 3260 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_color = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_config_append = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_dir = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_file = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_options = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_rotate_interval = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_rotate_interval_type = days {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] log_rotation_type = none {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] max_age = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] max_logfile_count = 30 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] max_logfile_size_mb = 200 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] max_over_subscription_ratio = 20.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] message_reap_interval = 86400 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] message_ttl = 2592000 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] migration_create_volume_timeout_secs = 300 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] monkey_patch = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] monkey_patch_modules = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] my_ip = 192.168.122.184 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] no_snapshot_gb_quota = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] num_iser_scan_tries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] num_shell_tries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] num_volume_device_scan_tries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] nvmeof_conn_info_version = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] nvmet_ns_id = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] nvmet_port_id = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_max_limit = 1000 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_volume_ext_list = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_volume_listen_port = 8776 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_volume_use_ssl = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] osapi_volume_workers = 2 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] per_volume_size_limit = -1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] periodic_fuzzy_delay = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] periodic_interval = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] public_endpoint = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] publish_errors = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_backup_gigabytes = 1000 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_backups = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_gigabytes = 1000 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_groups = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_snapshots = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] quota_volumes = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] rate_limit_burst = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] rate_limit_except_level = CRITICAL {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] rate_limit_interval = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] reinit_driver_count = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] replication_device = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] report_discard_supported = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] report_interval = 120 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82621) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] reservation_clean_interval = 86400 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] reservation_expire = 86400 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] reserved_image_namespaces = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] reserved_percentage = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] rpc_response_timeout = 120 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] run_external_periodic_tasks = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] scst_target_driver = iscsi {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] scst_target_iqn_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_down_time = 720 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] shell_completion = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] snapshot_name_template = snapshot-%s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] split_loggers = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] state_path = /opt/stack/data/cinder {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] storage_availability_zone = nova {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] storage_protocol = iSCSI {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] syslog_log_facility = LOG_USER {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] target_helper = lioadm {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] target_ip_address = 192.168.122.184 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] target_port = 3260 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] target_protocol = iscsi {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] target_secondary_ip_addresses = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] trace_flags = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] transport_url = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] until_refresh = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_chap_auth = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_default_quota_class = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_journal = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_json = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_multipath_for_image_xfer = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_stderr = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] use_syslog = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] verify_glance_signatures = enabled {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_api_class = cinder.volume.api.API {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_backend_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_clear = zero {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_clear_ionice = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_clear_size = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_copy_bps_limit = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_dd_blocksize = 1M {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_name_template = volume-%s {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_service_inithost_offload = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volume_usage_audit_period = month {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] zoning_mode = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_concurrency.disable_process_locking = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.admin_password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.admin_token = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.admin_user = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_port = 35357 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_protocol = https {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_section = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_type = password {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_uri = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.auth_version = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.cache = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.identity_uri = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.include_service_catalog = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.insecure = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.interface = public {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_password = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcache_username = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.region_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.service_type = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.184/identity {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.backend = dogpile.cache.null {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.backend_argument = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.backend_expiration_time = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.config_prefix = cache.oslo {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.debug_cache_backend = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.enable_retry_client = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.enable_socket_keepalive = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.enforce_fips_mode = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.expiration_time = 600 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.hashclient_retry_attempts = 2 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_dead_retry = 300 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_pool_maxsize = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_sasl_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.proxies = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.redis_db = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.redis_server = localhost:6379 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.retry_attempts = 2 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.retry_delay = 0.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.socket_keepalive_count = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.socket_keepalive_idle = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.socket_keepalive_interval = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.socket_timeout = 1.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.tls_allowed_ciphers = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.tls_cafile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82621) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 14:12:38 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 14:12:38 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Running cmd (subprocess): mount.quobyte {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.tls_certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.tls_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.tls_keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cache.username = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] coordination.backend_url = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.asyncio_connection = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.asyncio_slave_connection = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.backend = sqlalchemy {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.connection = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.connection_debug = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.connection_parameters = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.connection_recycle_time = 3600 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.connection_trace = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.db_inc_retry_interval = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.db_max_retries = 20 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.db_max_retry_interval = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.db_retry_interval = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.max_overflow = 50 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.max_pool_size = 5 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.max_retries = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.mysql_wsrep_sync_wait = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.pool_timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.retry_interval = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.slave_connection = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.sqlite_synchronous = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.synchronous_reader = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] database.use_db_reconnect = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.connection_string = messaging:// {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.es_doc_type = notification {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.es_scroll_size = 10000 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.es_scroll_time = 2m {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.filter_error_trace = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.hmac_keys = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.sentinel_service_name = mymaster {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack quobyte-client[82647]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.socket_timeout = 0.1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.trace_requests = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler.trace_sqlalchemy = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler_jaeger.process_tags = {} {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler_jaeger.service_name_prefix = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] profiler_otlp.service_name_prefix = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.enforce_new_defaults = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack quobyte-client[82647]: Invalid parameters found, error: missing mount point. Apr 13 14:12:38 devstack cinder-volume[82404]: WARNING oslo_config.cfg [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.enforce_scope = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.policy_default_rule = default {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.policy_file = policy.yaml {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack quobyte-client[82647]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.group = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack quobyte-client[82647]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.helper_command = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] privsep_osbrick.user = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.group = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.helper_command = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] cinder_sys_admin.user = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.auth_section = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.auth_type = password {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.cafile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.collect_timing = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.insecure = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.send_service_user_token = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.split_loggers = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] service_user.timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.auth_section = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.auth_type = password {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.collect_timing = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack sudo[82652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.insecure = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.region_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.split_loggers = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] glance.timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.backend_availability_zone = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack sudo[82652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.chap_password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.chap_username = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.disk_geometry = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.driver_client_cert = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.driver_client_cert_key = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.driver_data_namespace = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.driver_use_ssl = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.extra_capabilities = {} {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.filter_function = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.goodness_function = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.iscsi_target_flags = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.iscsi_write_cache = on {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.iser_helper = tgtadm {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.iser_ip_address = 192.168.122.184 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.iser_port = 3260 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_host = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_login = admin {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_mount_options = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_private_key = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_share_path = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.num_shell_tries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.quobyte_volume_url = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.replication_device = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.report_discard_supported = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.reserved_percentage = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.target_helper = tgtadm {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.target_ip_address = 192.168.122.184 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.target_port = 3260 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.target_protocol = iscsi {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.trace_flags = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.unique_fqdn_network = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.use_chap_auth = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_backend_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_clear = zero {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_clear_ionice = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_clear_size = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_reports.file_event_handler = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_reports.log_dir = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.backend_availability_zone = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.backend_host = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.chap_password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.chap_username = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.chiscsi_conf = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.disk_geometry = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.driver_client_cert = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.driver_data_namespace = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.driver_use_ssl = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.extra_capabilities = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.filter_function = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.goodness_function = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.iser_helper = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.iser_ip_address = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.iser_port = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.iser_target_prefix = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_host = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_login = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_mount_options = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_password = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_private_key = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_share_path = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_ssh_port = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.num_shell_tries = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.nvmet_port_id = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:38 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.replication_device = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.report_discard_supported = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.reserved_percentage = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.scst_target_driver = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.storage_protocol = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.target_helper = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.target_ip_address = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.target_port = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.target_prefix = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.target_protocol = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.trace_flags = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.use_chap_auth = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_clear = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_clear_size = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] QuobyteHD.volumes_dir = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.ssl = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_notifications.driver = [] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_notifications.retry = -1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] key_manager.fixed_key = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.barbican_api_version = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.barbican_endpoint = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.barbican_endpoint_type = public {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.barbican_region_name = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.cafile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.collect_timing = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.insecure = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.number_of_retries = 60 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.retry_delay = 1 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.send_service_user_token = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.split_loggers = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.verify_ssl = True {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican.verify_ssl_path = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.auth_section = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.auth_type = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.cafile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.certfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.collect_timing = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.insecure = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.keyfile = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.split_loggers = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] barbican_service_user.timeout = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.approle_role_id = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.approle_secret_id = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.kv_mountpoint = secret {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.kv_path = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.kv_version = 2 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.namespace = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.root_token_id = **** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.ssl_ca_crt_file = None {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.timeout = 60.0 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.use_ssl = False {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 14:12:39 devstack cinder-volume[82404]: DEBUG oslo_service.backend._eventlet.service [None req-d7131b86-3b36-4d07-a772-a1448a851b00 None None] ******************************************************************************** {{(pid=82404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.693s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:39 devstack cinder-volume[82621]: INFO cinder.volume.driver [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG cinder.volume.driver [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82621) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 14:12:39 devstack sudo[82652]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG oslo_db.sqlalchemy.engines [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writer thread running {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG cinder.db.sqlalchemy.api [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Building query based on filter {{(pid=82621) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82621) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:39 devstack cinder-volume[82621]: INFO cinder.keymgr.migration [None req-9dd75f03-5c05-4da2-9c31-e536102d848b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 14:12:39 devstack sudo[82682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:39 devstack sudo[82682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:40 devstack sudo[82682]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:12:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Driver initialization completed successfully. Apr 13 14:12:40 devstack cinder-volume[82621]: INFO cinder.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Initiating service 3 cleanup Apr 13 14:12:40 devstack cinder-volume[82621]: INFO cinder.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Service 3 cleanup completed. Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG cinder.service [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Creating RPC server for service cinder-volume {{(pid=82621) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG cinder.service [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82621) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 14:12:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:12:40 devstack sudo[82689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:12:40 devstack sudo[82689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:12:40 devstack sudo[82689]: pam_unix(sudo:session): session closed for user root Apr 13 14:12:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.418s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:12:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9ad38445-c3bd-4abe-9b66-2a4ab8177529 None None] Driver post RPC initialization completed successfully. Apr 13 14:12:48 devstack cinder-volume[82404]: DEBUG dbcounter [-] [82404] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:12:50 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:12:50 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=2 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Flow 'volume_create_manager' (f150d2a5-85fd-4187-bb4a-ce56aaf1d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3f77c2-8136-4c16-9f7a-16f8091ef439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3f77c2-8136-4c16-9f7a-16f8091ef439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-483712446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48e927f-9936-42d5-a224-1637c98aa2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cf6fcd9a564653826e806744250ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:39Z,use_quota=True,user_id='5637b796b5044ae79572f3142a2758f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e85f1a-7e06-4c57-b5c5-3b85eae8fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e85f1a-7e06-4c57-b5c5-3b85eae8fb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acd3ad2-6e48-42e3-8962-049a8210e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acd3ad2-6e48-42e3-8962-049a8210e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48e927f-9936-42d5-a224-1637c98aa2f8', 'volume_name': 'volume-c48e927f-9936-42d5-a224-1637c98aa2f8', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9458aa26-3695-4131-a729-d85b495ddd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9458aa26-3695-4131-a729-d85b495ddd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9d2194-3658-4d4a-b4b5-1da02ab142bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Volume c48e927f-9936-42d5-a224-1637c98aa2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48e927f-9936-42d5-a224-1637c98aa2f8', 'volume_size': 1} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-483712446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48e927f-9936-42d5-a224-1637c98aa2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cf6fcd9a564653826e806744250ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:39Z,use_quota=True,user_id='5637b796b5044ae79572f3142a2758f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Creating volume c48e927f-9936-42d5-a224-1637c98aa2f8 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:13:39 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:39 devstack sudo[83093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 1073741824 Apr 13 14:13:39 devstack sudo[83093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:39 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7d0ef303-6653-47d7-bb09-6858b9f06321 tempest-GroupsTest-145261844 None] Group tempest-Group1-1614127188: creating Apr 13 14:13:39 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7d0ef303-6653-47d7-bb09-6858b9f06321 tempest-GroupsTest-145261844 None] Group tempest-Group1-1614127188: created successfully Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Flow 'volume_create_manager' (d333a860-b1b2-4714-af14-d408ae2a1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86377a4-72a0-4662-9c85-346153ae87ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7d0ef303-6653-47d7-bb09-6858b9f06321 tempest-GroupsTest-145261844 None] Create group completed successfully. Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86377a4-72a0-4662-9c85-346153ae87ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-190037029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b414f75-6565-47f3-8c50-44ad1a2f9f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc65ba46e0c94e16ae020a2cd781becd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:39Z,use_quota=True,user_id='1137551dead3411b85bf1b175482bad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93ac5ad-c805-4daa-8faf-9a7c70cebb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93ac5ad-c805-4daa-8faf-9a7c70cebb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592253ae-1e22-4b02-b005-945c9ebf4929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592253ae-1e22-4b02-b005-945c9ebf4929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b414f75-6565-47f3-8c50-44ad1a2f9f56', 'volume_name': 'volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae75af3-ce26-4744-a0cb-9c36be24051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae75af3-ce26-4744-a0cb-9c36be24051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f75898-8cde-4d43-9982-d9ead07d8baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Volume 8b414f75-6565-47f3-8c50-44ad1a2f9f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56', 'volume_size': 1} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Flow 'volume_create_manager' (ad470f6d-ad58-4689-8cf6-a369802cb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13697368-277a-43d8-b800-89e6cd0d375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13697368-277a-43d8-b800-89e6cd0d375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-844421028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f98c0ad-e159-439f-9493-33237b70081b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdfffe2249b4de6bb6b841e056a3e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:40Z,use_quota=True,user_id='9071e13595054439ba2297644731165a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f0e797-8a02-4130-9447-02a937fbc31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f0e797-8a02-4130-9447-02a937fbc31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a903613-4c41-4a42-a801-2310d1be2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a903613-4c41-4a42-a801-2310d1be2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f98c0ad-e159-439f-9493-33237b70081b', 'volume_name': 'volume-6f98c0ad-e159-439f-9493-33237b70081b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661b878f-8799-41c9-88db-7d2db863ba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661b878f-8799-41c9-88db-7d2db863ba3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c142de66-a4b9-4714-afa6-b7d82bd7c3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Volume 6f98c0ad-e159-439f-9493-33237b70081b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f98c0ad-e159-439f-9493-33237b70081b', 'volume_size': 1} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0bce76c4-46d9-4369-8201-c697ff50e004 tempest-GroupsTest-145261844 None] Group tempest-Group2-2026663298: creating Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0bce76c4-46d9-4369-8201-c697ff50e004 tempest-GroupsTest-145261844 None] Group tempest-Group2-2026663298: created successfully Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0bce76c4-46d9-4369-8201-c697ff50e004 tempest-GroupsTest-145261844 None] Create group completed successfully. Apr 13 14:13:40 devstack sudo[83093]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 1073741824" returned: 0 in 0.904s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:40 devstack sudo[83415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 Apr 13 14:13:40 devstack sudo[83415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:40 devstack sudo[83415]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8" returned: 0 in 0.428s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-190037029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b414f75-6565-47f3-8c50-44ad1a2f9f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc65ba46e0c94e16ae020a2cd781becd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:39Z,use_quota=True,user_id='1137551dead3411b85bf1b175482bad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Creating volume 8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9d2194-3658-4d4a-b4b5-1da02ab142bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48e927f-9936-42d5-a224-1637c98aa2f8', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8117321-2284-4d13-8b93-294e712f8c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:40 devstack sudo[83418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 1073741824 Apr 13 14:13:40 devstack sudo[83418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Volume volume-c48e927f-9936-42d5-a224-1637c98aa2f8 (c48e927f-9936-42d5-a224-1637c98aa2f8): created successfully Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8117321-2284-4d13-8b93-294e712f8c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Flow 'volume_create_manager' (f150d2a5-85fd-4187-bb4a-ce56aaf1d98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d93afd3e-4ef9-48d5-b876-e6d88b5ac0bb tempest-VolumesAdminNegativeTest-1462431368 None] Created volume successfully. Apr 13 14:13:41 devstack sudo[83418]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 1073741824" returned: 0 in 0.563s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:41 devstack sudo[83423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 Apr 13 14:13:41 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Flow 'volume_create_manager' (afb78b24-cf93-4a50-9534-00c62e9cc5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d1e281-03b8-4862-8166-5dec11eb847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d1e281-03b8-4862-8166-5dec11eb847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609916558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3ce2472-9728-4151-947a-e639386d0130,host='devstack@QuobyteHD#QuobyteHD',id=5944a719-76b7-43ba-9589-3e69701f2ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d98869f28d40cdaa45670d17e2ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:42Z,use_quota=True,user_id='7b2ebedbfed34d28aab0fedae22080e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d46739-f209-46c2-910d-84192a3ddbf5),volume_type_id=f3d46739-f209-46c2-910d-84192a3ddbf5)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a329fe78-95ba-403d-b174-6c3407e2bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a329fe78-95ba-403d-b174-6c3407e2bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c0d108-f8d7-49bb-8bac-49c11ca5ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c0d108-f8d7-49bb-8bac-49c11ca5ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5944a719-76b7-43ba-9589-3e69701f2ceb', 'volume_name': 'volume-5944a719-76b7-43ba-9589-3e69701f2ceb', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278b5122-c619-4c85-b823-85389cee9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278b5122-c619-4c85-b823-85389cee9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b688515-4e07-490c-b7ed-81cf2c6958b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:41 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Volume 5944a719-76b7-43ba-9589-3e69701f2ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5944a719-76b7-43ba-9589-3e69701f2ceb', 'volume_size': 1} Apr 13 14:13:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:42 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56" returned: 0 in 0.539s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-844421028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f98c0ad-e159-439f-9493-33237b70081b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdfffe2249b4de6bb6b841e056a3e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:40Z,use_quota=True,user_id='9071e13595054439ba2297644731165a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Creating volume 6f98c0ad-e159-439f-9493-33237b70081b {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:13:42 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f75898-8cde-4d43-9982-d9ead07d8baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eab2853-b36a-46c9-a34f-a0689788ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:42 devstack sudo[83427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b 1073741824 Apr 13 14:13:42 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Volume volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 (8b414f75-6565-47f3-8c50-44ad1a2f9f56): created successfully Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eab2853-b36a-46c9-a34f-a0689788ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Flow 'volume_create_manager' (d333a860-b1b2-4714-af14-d408ae2a1010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-ccb2227e-4a26-4d2c-9eaa-fd0282cf3cc6 req-51efa2dc-2aa2-485d-b5f3-e68690dd84c2 tempest-VolumesSnapshotsTestJSON-798967501 None] Created volume successfully. Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Acquiring lock "cinder-c48e927f-9936-42d5-a224-1637c98aa2f8-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Lock "cinder-c48e927f-9936-42d5-a224-1637c98aa2f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Acquiring lock "cinder-quobyte-c48e927f-9936-42d5-a224-1637c98aa2f8" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Lock "cinder-quobyte-c48e927f-9936-42d5-a224-1637c98aa2f8" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:42 devstack cinder-volume[82621]: INFO oslo.privsep.daemon [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqzl4vsr8/privsep.sock'] Apr 13 14:13:42 devstack sudo[83429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqzl4vsr8/privsep.sock Apr 13 14:13:42 devstack sudo[83429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 14:13:42 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 13 14:13:42 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b 1073741824" returned: 0 in 0.726s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:42 devstack sudo[83436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b Apr 13 14:13:42 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 14:13:43 devstack cinder-volume[82621]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 13 14:13:43 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b" returned: 0 in 0.511s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e3ce2472-9728-4151-947a-e639386d0130,created_at=2026-04-13T12:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609916558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3ce2472-9728-4151-947a-e639386d0130,host='devstack@QuobyteHD#QuobyteHD',id=5944a719-76b7-43ba-9589-3e69701f2ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d98869f28d40cdaa45670d17e2ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:42Z,use_quota=True,user_id='7b2ebedbfed34d28aab0fedae22080e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d46739-f209-46c2-910d-84192a3ddbf5),volume_type_id=f3d46739-f209-46c2-910d-84192a3ddbf5)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Creating volume 5944a719-76b7-43ba-9589-3e69701f2ceb {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:13:43 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c142de66-a4b9-4714-afa6-b7d82bd7c3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f98c0ad-e159-439f-9493-33237b70081b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bd0be1-7c7a-4f60-9a8c-5b5b8b50759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:43 devstack sudo[83439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb 1073741824 Apr 13 14:13:43 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:43 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Volume volume-6f98c0ad-e159-439f-9493-33237b70081b (6f98c0ad-e159-439f-9493-33237b70081b): created successfully Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33bd0be1-7c7a-4f60-9a8c-5b5b8b50759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Flow 'volume_create_manager' (ad470f6d-ad58-4689-8cf6-a369802cb631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d6fb4a20-c8fb-48ce-bdd0-18b38804a699 tempest-DeleteServersTestJSON-344164094 None] Created volume successfully. Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:43 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb 1073741824" returned: 0 in 0.662s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:44 devstack sudo[83429]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:44 devstack cinder-volume[82621]: INFO oslo.privsep.daemon [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Spawned new privsep daemon via rootwrap Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Accepted privsep connection to /tmp/tmpqzl4vsr8/privsep.sock {{(pid=82621) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 13 14:13:44 devstack sudo[83447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb Apr 13 14:13:44 devstack sudo[83447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:44 devstack cinder-volume[82621]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 13 14:13:44 devstack cinder-volume[82621]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 13 14:13:44 devstack cinder-volume[82621]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 13 14:13:44 devstack cinder-volume[82621]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83442 Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b988cb-86e4-42ea-9fe4-2177037f56e3]: (2,) {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6778d794-389d-498c-b1bd-d720d8bb7444]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:44 devstack sudo[83450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 Apr 13 14:13:44 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:44 devstack sudo[83447]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.938s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b688515-4e07-490c-b7ed-81cf2c6958b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5944a719-76b7-43ba-9589-3e69701f2ceb', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4ae354-1e9e-41f2-8c72-21ec8a76432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Creating offline snapshot 04c6a796-9068-44f2-acf0-3b06b7961e67 of volume 8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:13:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Volume volume-5944a719-76b7-43ba-9589-3e69701f2ceb (5944a719-76b7-43ba-9589-3e69701f2ceb): created successfully Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4ae354-1e9e-41f2-8c72-21ec8a76432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Flow 'volume_create_manager' (afb78b24-cf93-4a50-9534-00c62e9cc5af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f42163c-6906-406a-98e1-f5f6bd9376d3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-47c3ddb8-21b2-4cf6-b9b6-489bbed95d60 tempest-GroupsTest-145261844 None] Created volume successfully. Apr 13 14:13:44 devstack sudo[83455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 Apr 13 14:13:44 devstack sudo[83455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:44 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8" returned: 0 in 0.667s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:44 devstack sudo[83466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8 Apr 13 14:13:44 devstack sudo[83466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:45 devstack sudo[83455]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56" returned: 0 in 0.616s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:45 devstack sudo[83472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 1G Apr 13 14:13:45 devstack sudo[83472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:45 devstack sudo[83466]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c48e927f-9936-42d5-a224-1637c98aa2f8" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Lock "cinder-quobyte-c48e927f-9936-42d5-a224-1637c98aa2f8" released by "delete_volume" :: held 2.950s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:45 devstack cinder-volume[82621]: WARNING cinder.quota [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:13:45 devstack cinder-volume[82621]: WARNING cinder.quota [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Created reservations ['7ed72b96-2060-44d0-a4a8-f76d374252d7', '807bd502-6dfa-4176-b2c1-0b1d9226f832', '63eabdb7-ef92-449a-8648-8abbf10f52d8', '756846a0-988c-4b9a-9eed-b2889a6b9a36'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:45 devstack sudo[83475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:13:45 devstack sudo[83475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Acquiring lock "cinder-quobyte-5944a719-76b7-43ba-9589-3e69701f2ceb" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Lock "cinder-quobyte-5944a719-76b7-43ba-9589-3e69701f2ceb" acquired by "delete_volume" :: waited 0.027s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e08b42d-ed3f-433a-ab7c-e1ddea024a89]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:46 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb Apr 13 14:13:46 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:46 devstack sudo[83472]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 1G" returned: 0 in 1.138s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:46 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 Apr 13 14:13:46 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:46 devstack sudo[83475]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.926s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:13:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Deleted volume successfully. Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-31aa6e84-e9af-49f7-b9ac-0d54fc13c6fa tempest-VolumesAdminNegativeTest-1462431368 None] Lock "cinder-c48e927f-9936-42d5-a224-1637c98aa2f8-delete_volume" released by "delete_volume" :: held 4.159s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:46 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb" returned: 0 in 0.749s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:46 devstack sudo[83492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb Apr 13 14:13:46 devstack sudo[83492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:47 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67" returned: 0 in 0.740s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:47 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 is being set with open permissions: ugo+rw Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:47 devstack sudo[83503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 Apr 13 14:13:47 devstack sudo[83503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:47 devstack sudo[83492]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5944a719-76b7-43ba-9589-3e69701f2ceb" returned: 0 in 0.677s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Lock "cinder-quobyte-5944a719-76b7-43ba-9589-3e69701f2ceb" released by "delete_volume" :: held 1.467s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Created reservations ['0dbf5050-373a-4187-bb8d-f6ef8c1701df'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:13:47 devstack cinder-volume[82621]: WARNING cinder.quota [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1227053543 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1227053543, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:13:47 devstack cinder-volume[82621]: WARNING cinder.quota [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1227053543 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1227053543, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Created reservations ['bdbf071a-37f4-4bec-9c89-7a09811d202e', 'eca17556-58a4-449c-bfa5-1b3f79b09359', '0a63c63d-ec32-4698-9cda-f9596069b3a5', '25f8d04e-05f7-4ba3-ab51-026b9b46e6db'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:47 devstack sudo[83531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:13:47 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:47 devstack sudo[83503]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67" returned: 0 in 0.794s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:47 devstack sudo[83538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info Apr 13 14:13:47 devstack sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:48 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.600s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:13:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-86c201ef-f509-4c03-9a41-661917a5c33d tempest-GroupsTest-145261844 None] Delete group completed successfully. Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Created reservations ['05243095-fb74-4184-b7a3-bcd9929a41ed'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:48 devstack sudo[83538]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info" returned: 0 in 0.519s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:48 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info is being set with open permissions: ugo+rw Apr 13 14:13:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:48 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info Apr 13 14:13:48 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:48 devstack sudo[83544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:13:48 devstack sudo[83544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:49 devstack sudo[83544]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.581s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:13:49 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-103c9530-6cf1-4ba8-8e4a-bc9fa29e57b9 tempest-GroupsTest-145261844 None] Delete group completed successfully. Apr 13 14:13:49 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.info" returned: 0 in 0.670s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.609s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:49 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-6894c369-8930-4b67-848e-804cc6a7230b req-ea181f61-af55-448b-95a7-f259d3856509 tempest-VolumesSnapshotsTestJSON-798967501 None] Create snapshot completed successfully Apr 13 14:13:49 devstack cinder-volume[82621]: WARNING py.warnings [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 13 14:13:49 devstack cinder-volume[82621]: .first() Apr 13 14:13:49 devstack cinder-volume[82621]: Apr 13 14:13:49 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7dfcfa39-fd6d-44bb-beab-d41bb6bb595e tempest-GroupsTest-145261844 None] Group tempest-GroupsTest-Group-1647636463: creating Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5e4067-80b1-4e6a-9c46-eb26222eff94]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:49 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7dfcfa39-fd6d-44bb-beab-d41bb6bb595e tempest-GroupsTest-145261844 None] Group tempest-GroupsTest-Group-1647636463: created successfully Apr 13 14:13:49 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7dfcfa39-fd6d-44bb-beab-d41bb6bb595e tempest-GroupsTest-145261844 None] Create group completed successfully. Apr 13 14:13:49 devstack sudo[83566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b Apr 13 14:13:49 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "cinder-04c6a796-9068-44f2-acf0-3b06b7961e67-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-04c6a796-9068-44f2-acf0-3b06b7961e67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "cinder-quobyte-8b414f75-6565-47f3-8c50-44ad1a2f9f56" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-quobyte-8b414f75-6565-47f3-8c50-44ad1a2f9f56" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "cinder-quobyte-04c6a796-9068-44f2-acf0-3b06b7961e67" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-quobyte-04c6a796-9068-44f2-acf0-3b06b7961e67" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Deleting offline snapshot 04c6a796-9068-44f2-acf0-3b06b7961e67 of volume 8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] snapshot_file for this snap is: volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ec32a-4688-4f79-91a8-df6548f5852c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:50 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 Apr 13 14:13:50 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:50 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b" returned: 0 in 0.590s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.607s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1', 'name': 'volume-6f98c0ad-e159-439f-9493-33237b70081b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d82c1ca-1b41-45a8-b373-5bdca8139e5e', 'enforce_multipath': True} {{(pid=82621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 14:13:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-a766e75d-be8d-4917-b02a-76e980caa78d req-e409b4cd-783c-4ced-ba54-8177ade67979 tempest-DeleteServersTestJSON-344164094 None] attachment_update completed successfully. Apr 13 14:13:50 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa74802-8bc7-4381-8ee7-75db2c26912d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:50 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 Apr 13 14:13:50 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:51 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56" returned: 0 in 0.641s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:51 devstack sudo[83604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 Apr 13 14:13:51 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Flow 'volume_create_manager' (26abed0c-8177-4d1f-abe7-699343cb8486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd38d73a-db6e-475a-a318-6054608ff47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd38d73a-db6e-475a-a318-6054608ff47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223467073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7de2bc73-ff6c-40cc-81a8-051b60b2e71c,host='devstack@QuobyteHD#QuobyteHD',id=94b7f731-84e8-4405-aace-5e60926d76ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d98869f28d40cdaa45670d17e2ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:51Z,use_quota=True,user_id='7b2ebedbfed34d28aab0fedae22080e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecb0525a-78ac-4310-a801-4be1ab51d130),volume_type_id=ecb0525a-78ac-4310-a801-4be1ab51d130)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec39038-b19b-4502-888f-c9f2e5452444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec39038-b19b-4502-888f-c9f2e5452444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fed76e-4fc2-4f5c-bd07-d13ac909bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fed76e-4fc2-4f5c-bd07-d13ac909bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b7f731-84e8-4405-aace-5e60926d76ea', 'volume_name': 'volume-94b7f731-84e8-4405-aace-5e60926d76ea', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a427bec-26a2-4d7f-8282-0e363bb2eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a427bec-26a2-4d7f-8282-0e363bb2eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09928357-57c2-4bf5-a5c4-6e88df4538db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:51 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Volume 94b7f731-84e8-4405-aace-5e60926d76ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b7f731-84e8-4405-aace-5e60926d76ea', 'volume_size': 1} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7de2bc73-ff6c-40cc-81a8-051b60b2e71c,created_at=2026-04-13T12:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223467073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7de2bc73-ff6c-40cc-81a8-051b60b2e71c,host='devstack@QuobyteHD#QuobyteHD',id=94b7f731-84e8-4405-aace-5e60926d76ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d98869f28d40cdaa45670d17e2ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:51Z,use_quota=True,user_id='7b2ebedbfed34d28aab0fedae22080e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecb0525a-78ac-4310-a801-4be1ab51d130),volume_type_id=ecb0525a-78ac-4310-a801-4be1ab51d130)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Creating volume 94b7f731-84e8-4405-aace-5e60926d76ea {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:13:51 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:51 devstack sudo[83651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea 1073741824 Apr 13 14:13:51 devstack sudo[83651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:51 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67" returned: 0 in 0.532s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:51 devstack sudo[83659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67 Apr 13 14:13:51 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:51 devstack sudo[83651]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea 1073741824" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:51 devstack sudo[83977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea Apr 13 14:13:51 devstack sudo[83977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:52 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56.04c6a796-9068-44f2-acf0-3b06b7961e67" returned: 0 in 0.504s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-quobyte-04c6a796-9068-44f2-acf0-3b06b7961e67" released by "_delete_snapshot" :: held 2.207s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-quobyte-8b414f75-6565-47f3-8c50-44ad1a2f9f56" released by "delete_snapshot" :: held 2.246s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:52 devstack cinder-volume[82621]: WARNING cinder.quota [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.quota [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Created reservations ['10f1efc5-5030-467f-8308-b222646206cc', 'fbe921af-4768-4689-b56a-e9c103058070', '85532a81-9142-4250-8387-db714203f887', '2169c3f4-9f92-4296-a8e1-043f6860ca23'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:13:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Delete snapshot completed successfully. Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-0d3a91f3-bc22-4ebf-bbc0-dee422b7637f req-f6782263-b39a-4a62-8ef8-a9e47d9c0130 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-04c6a796-9068-44f2-acf0-3b06b7961e67-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:52 devstack sudo[83977]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea" returned: 0 in 0.504s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09928357-57c2-4bf5-a5c4-6e88df4538db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b7f731-84e8-4405-aace-5e60926d76ea', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85d1b9b-3ebe-4ff1-af7f-b43703e2b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:52 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Volume volume-94b7f731-84e8-4405-aace-5e60926d76ea (94b7f731-84e8-4405-aace-5e60926d76ea): created successfully Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85d1b9b-3ebe-4ff1-af7f-b43703e2b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Flow 'volume_create_manager' (26abed0c-8177-4d1f-abe7-699343cb8486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-40b57ea9-9c56-4a96-8288-cd9835feda16 tempest-GroupsTest-145261844 None] Created volume successfully. Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "cinder-8b414f75-6565-47f3-8c50-44ad1a2f9f56-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-8b414f75-6565-47f3-8c50-44ad1a2f9f56-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "cinder-quobyte-8b414f75-6565-47f3-8c50-44ad1a2f9f56" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-quobyte-8b414f75-6565-47f3-8c50-44ad1a2f9f56" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de14b06-6d20-48e4-94da-b5f00bba28e8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:53 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 Apr 13 14:13:53 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Flow 'volume_create_manager' (af4cfc06-1705-4004-824b-fdb25a5b52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85b5a67-6fe7-405b-bb7b-6b86488fb2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85b5a67-6fe7-405b-bb7b-6b86488fb2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641214857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7de2bc73-ff6c-40cc-81a8-051b60b2e71c,host='devstack@QuobyteHD#QuobyteHD',id=7b53200f-d59d-465d-97ab-9379a8fb3716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d98869f28d40cdaa45670d17e2ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:54Z,use_quota=True,user_id='7b2ebedbfed34d28aab0fedae22080e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecb0525a-78ac-4310-a801-4be1ab51d130),volume_type_id=ecb0525a-78ac-4310-a801-4be1ab51d130)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1ce8c7-effe-4a86-b28f-ebc6c0ee58e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1ce8c7-effe-4a86-b28f-ebc6c0ee58e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8c843b-1224-4c84-bdd7-376a36d4b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8c843b-1224-4c84-bdd7-376a36d4b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b53200f-d59d-465d-97ab-9379a8fb3716', 'volume_name': 'volume-7b53200f-d59d-465d-97ab-9379a8fb3716', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cbcbfa-0efc-4757-a4d6-44d5380be676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cbcbfa-0efc-4757-a4d6-44d5380be676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc5b0f5-95bd-458d-bffe-9ae7635eeb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:53 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Volume 7b53200f-d59d-465d-97ab-9379a8fb3716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b53200f-d59d-465d-97ab-9379a8fb3716', 'volume_size': 1} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7de2bc73-ff6c-40cc-81a8-051b60b2e71c,created_at=2026-04-13T12:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1641214857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7de2bc73-ff6c-40cc-81a8-051b60b2e71c,host='devstack@QuobyteHD#QuobyteHD',id=7b53200f-d59d-465d-97ab-9379a8fb3716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d98869f28d40cdaa45670d17e2ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:13:54Z,use_quota=True,user_id='7b2ebedbfed34d28aab0fedae22080e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecb0525a-78ac-4310-a801-4be1ab51d130),volume_type_id=ecb0525a-78ac-4310-a801-4be1ab51d130)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Creating volume 7b53200f-d59d-465d-97ab-9379a8fb3716 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:13:53 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:13:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:54 devstack sudo[83991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 1073741824 Apr 13 14:13:54 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:54 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56" returned: 0 in 0.763s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:54 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56 Apr 13 14:13:54 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:54 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 1073741824" returned: 0 in 0.654s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:54 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 Apr 13 14:13:54 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:54 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b414f75-6565-47f3-8c50-44ad1a2f9f56" returned: 0 in 0.643s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-quobyte-8b414f75-6565-47f3-8c50-44ad1a2f9f56" released by "delete_volume" :: held 1.439s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG cinder.quota [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Created reservations ['7d1863d7-c60a-4ff1-a3d9-c4dfd5f7ea5c', '57dedf63-7eb1-41a5-8066-b92b4eca409a', '3ce0c1e4-9a8d-4953-bdb0-b1bbcd018828', 'e0dc7204-f5ca-4ca3-ab4a-132664ced250'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:54 devstack sudo[84016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:13:54 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:55 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716" returned: 0 in 0.729s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc5b0f5-95bd-458d-bffe-9ae7635eeb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b53200f-d59d-465d-97ab-9379a8fb3716', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c28989-960e-43d9-b3bd-578068d5df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:13:55 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Volume volume-7b53200f-d59d-465d-97ab-9379a8fb3716 (7b53200f-d59d-465d-97ab-9379a8fb3716): created successfully Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c28989-960e-43d9-b3bd-578068d5df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Flow 'volume_create_manager' (af4cfc06-1705-4004-824b-fdb25a5b52af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:13:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ac348e70-e587-492e-b40a-93adfbaedc9a tempest-GroupsTest-145261844 None] Created volume successfully. Apr 13 14:13:55 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.641s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.manager [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:13:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Deleted volume successfully. Apr 13 14:13:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-dc82913d-ec03-448d-a9a8-7da963269065 req-a2bffbcd-41a4-419b-a592-87df141b61e0 tempest-VolumesSnapshotsTestJSON-798967501 None] Lock "cinder-8b414f75-6565-47f3-8c50-44ad1a2f9f56-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:56 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-96bb4816-d3b6-4bd6-9f17-cacb131acd18 tempest-GroupsTest-145261844 None] Update group completed successfully. Apr 13 14:13:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fd3c9ad8-f374-43b0-b88c-89eb8676e33d tempest-GroupsTest-145261844 None] Update group completed successfully. Apr 13 14:13:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1ab64bb9-573d-403a-b98d-fb8df218c50a tempest-GroupSnapshotsTest-343835572 None] Group tempest-GroupSnapshotsTest-Group-569499571: creating Apr 13 14:13:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1ab64bb9-573d-403a-b98d-fb8df218c50a tempest-GroupSnapshotsTest-343835572 None] Group tempest-GroupSnapshotsTest-Group-569499571: created successfully Apr 13 14:13:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1ab64bb9-573d-403a-b98d-fb8df218c50a tempest-GroupSnapshotsTest-343835572 None] Create group completed successfully. Apr 13 14:13:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Acquiring lock "cinder-quobyte-7b53200f-d59d-465d-97ab-9379a8fb3716" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:13:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Lock "cinder-quobyte-7b53200f-d59d-465d-97ab-9379a8fb3716" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b1c965-d8fb-400f-95f9-75057b9c2c6a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:59 devstack sudo[84086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 Apr 13 14:13:59 devstack sudo[84086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:59 devstack sudo[84086]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716" returned: 0 in 0.488s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:13:59 devstack sudo[84093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716 Apr 13 14:13:59 devstack sudo[84093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:13:59 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-95a535c5-7cae-466f-a442-063ec9f037e3 req-08292848-b6bf-486d-9f52-30d744298e2d tempest-DeleteServersTestJSON-344164094 None] Terminate volume connection completed successfully. Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-95a535c5-7cae-466f-a442-063ec9f037e3 req-08292848-b6bf-486d-9f52-30d744298e2d tempest-DeleteServersTestJSON-344164094 None] Deleting attachment 3d82c1ca-1b41-45a8-b373-5bdca8139e5e. {{(pid=82621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 14:13:59 devstack sudo[84093]: pam_unix(sudo:session): session closed for user root Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b53200f-d59d-465d-97ab-9379a8fb3716" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Lock "cinder-quobyte-7b53200f-d59d-465d-97ab-9379a8fb3716" released by "delete_volume" :: held 1.004s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:13:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Acquiring lock "cinder-quobyte-94b7f731-84e8-4405-aace-5e60926d76ea" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Lock "cinder-quobyte-94b7f731-84e8-4405-aace-5e60926d76ea" acquired by "delete_volume" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[494eaf1f-1a84-4814-be95-0677d8bf5170]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (61f80bd6-4ff9-4c0a-9e7d-5d7e7a78f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c255f296-baca-482c-af7d-b475535d8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c255f296-baca-482c-af7d-b475535d8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564525496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a63408bd-dade-489e-9d55-509de362ec5c,host='devstack@QuobyteHD#QuobyteHD',id=305ddac7-2cfe-4c97-9f4d-82bbf87e3a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:00Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40d99d63-5dc6-4acb-ae76-75c9e1858949),volume_type_id=40d99d63-5dc6-4acb-ae76-75c9e1858949)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a0c081-7451-40c0-a069-67dba47973a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a0c081-7451-40c0-a069-67dba47973a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe7481e-722b-47bf-8e58-0dbd8c146898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe7481e-722b-47bf-8e58-0dbd8c146898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305ddac7-2cfe-4c97-9f4d-82bbf87e3a54', 'volume_name': 'volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bdfe3a-3332-4a1b-a329-f525bbbfe5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:00 devstack sudo[84097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bdfe3a-3332-4a1b-a329-f525bbbfe5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:00 devstack sudo[84097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625bdb30-f17b-4ccf-84fd-b7b3e1126475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:00 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Volume 305ddac7-2cfe-4c97-9f4d-82bbf87e3a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54', 'volume_size': 1} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a63408bd-dade-489e-9d55-509de362ec5c,created_at=2026-04-13T12:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564525496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a63408bd-dade-489e-9d55-509de362ec5c,host='devstack@QuobyteHD#QuobyteHD',id=305ddac7-2cfe-4c97-9f4d-82bbf87e3a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:00Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40d99d63-5dc6-4acb-ae76-75c9e1858949),volume_type_id=40d99d63-5dc6-4acb-ae76-75c9e1858949)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Creating volume 305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:00 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:00 devstack sudo[84099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 1073741824 Apr 13 14:14:00 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:00 devstack sudo[84097]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea" returned: 0 in 0.585s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:00 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea Apr 13 14:14:00 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:00 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 1073741824" returned: 0 in 0.614s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:00 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:00 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:01 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-94b7f731-84e8-4405-aace-5e60926d76ea" returned: 0 in 0.527s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Lock "cinder-quobyte-94b7f731-84e8-4405-aace-5e60926d76ea" released by "delete_volume" :: held 1.140s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Created reservations ['3ac304b6-23f8-4a6a-83b1-4f6df08f9f94'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:01 devstack cinder-volume[82621]: WARNING cinder.quota [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1367171911 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1367171911, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:01 devstack cinder-volume[82621]: WARNING cinder.quota [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1367171911 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1367171911, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:01 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.448s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625bdb30-f17b-4ccf-84fd-b7b3e1126475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1fa05-3260-4f5a-be10-2213e77ec3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Created reservations ['4191a370-fdd3-4a3d-a235-ea7e85b32435', '67613b70-0d75-45c7-b4df-ae206c171462', 'e3daed80-8647-4e92-b8b1-03ce1d36d67a', '73c8b097-dd08-4305-931d-c8fc962edefd'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:01 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Volume volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 (305ddac7-2cfe-4c97-9f4d-82bbf87e3a54): created successfully Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1fa05-3260-4f5a-be10-2213e77ec3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (61f80bd6-4ff9-4c0a-9e7d-5d7e7a78f043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-70aa8d49-d4f0-435b-ae05-315ffc742f89 tempest-GroupSnapshotsTest-343835572 None] Created volume successfully. Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Created reservations ['2ac9b9e7-3b55-4dd0-99c8-d042f2db6e9b', 'd86dfee3-f6b7-443b-8977-1cea3b793b8c', '80edee25-6894-41d9-bed8-bca694007d45', '6205fb39-e2d0-4405-b3d6-f19678edbd89'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:01 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:01 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:01 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:01 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-367ae9ae-680a-402b-b4c4-53b7490e7a3f tempest-GroupsTest-145261844 None] Delete group completed successfully. Apr 13 14:14:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] GroupSnapshot 36d3409d-f82f-4ef3-b436-fba1ad1afed7: creating. Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Group snapshot 36d3409d-f82f-4ef3-b436-fba1ad1afed7: creating. {{(pid=82621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Creating offline snapshot 0f7e8941-1f9f-4bdb-8eeb-399acf211942 of volume 305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a61963-7af7-495a-b0f0-50c2b7525279]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:02 devstack sudo[84119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:02 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:02 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.508s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:02 devstack sudo[84124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 1G Apr 13 14:14:02 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:03 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 1G" returned: 0 in 0.609s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:03 devstack sudo[84129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 Apr 13 14:14:03 devstack sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Acquiring lock "cinder-6f98c0ad-e159-439f-9493-33237b70081b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Lock "cinder-6f98c0ad-e159-439f-9493-33237b70081b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Acquiring lock "cinder-quobyte-6f98c0ad-e159-439f-9493-33237b70081b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Lock "cinder-quobyte-6f98c0ad-e159-439f-9493-33237b70081b" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd35a3d-0cdf-4433-972f-08b5534d0158]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:03 devstack sudo[84132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b Apr 13 14:14:03 devstack sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:03 devstack sudo[84129]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942" returned: 0 in 0.469s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:03 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:03 devstack sudo[84137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 Apr 13 14:14:03 devstack sudo[84137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:04 devstack sudo[84132]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b" returned: 0 in 0.650s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:04 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b Apr 13 14:14:04 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:04 devstack sudo[84137]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:04 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info Apr 13 14:14:04 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:04 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6f98c0ad-e159-439f-9493-33237b70081b" returned: 0 in 0.554s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Lock "cinder-quobyte-6f98c0ad-e159-439f-9493-33237b70081b" released by "delete_volume" :: held 1.240s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Created reservations ['70f34662-f018-49f7-b285-643a9ddbefcc', '7d5b6e47-a353-43fd-bd89-486c0a6a0fe5', '0140c4dc-0020-4daa-a621-85f01663fef1', '65a1c5d0-66c8-41bd-8aab-516e9ff46fda'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:04 devstack sudo[84148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:04 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:05 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info" returned: 0 in 0.523s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:05 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:05 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info Apr 13 14:14:05 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:05 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:05 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Deleted volume successfully. Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a88d08f7-8971-481f-b4a0-f511f49b7e20 tempest-DeleteServersTestJSON-344164094 None] Lock "cinder-6f98c0ad-e159-439f-9493-33237b70081b-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:05 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.info" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:05 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8da148cd-004d-4d76-a6f8-3616689b8293 tempest-GroupSnapshotsTest-343835572 None] group_snapshot 36d3409d-f82f-4ef3-b436-fba1ad1afed7: created successfully Apr 13 14:14:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-75ca1d66-fb95-458a-a474-adeead382faa tempest-GroupsV320Test-968461334 None] Group tempest-GroupsV320Test-Group-103873310: creating Apr 13 14:14:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-75ca1d66-fb95-458a-a474-adeead382faa tempest-GroupsV320Test-968461334 None] Group tempest-GroupsV320Test-Group-103873310: created successfully Apr 13 14:14:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-75ca1d66-fb95-458a-a474-adeead382faa tempest-GroupsV320Test-968461334 None] Create group completed successfully. Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-0f7e8941-1f9f-4bdb-8eeb-399acf211942-0478742d-d632-4aab-8bdf-be6c542741dd" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0f7e8941-1f9f-4bdb-8eeb-399acf211942-0478742d-d632-4aab-8bdf-be6c542741dd" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Creating volume 0478742d-d632-4aab-8bdf-be6c542741dd from snapshot 0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-0478742d-d632-4aab-8bdf-be6c542741dd" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0478742d-d632-4aab-8bdf-be6c542741dd" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] snapshot: 0f7e8941-1f9f-4bdb-8eeb-399acf211942, volume: 0478742d-d632-4aab-8bdf-be6c542741dd, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff8222a-aada-41e8-8aef-6b28da456820]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:07 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 Apr 13 14:14:07 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Created reservations ['f7f7f65c-f67c-462b-a1b4-1c5b0dcd073e'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:07 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:07 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:08 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942" returned: 0 in 0.797s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d00fb-eac3-41ab-9c48-08abef827473]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:08 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.533s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:08 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f168fe11-0ba6-43b4-951b-89521bd2c62a tempest-GroupsV320Test-968461334 None] Delete group completed successfully. Apr 13 14:14:08 devstack sudo[84164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:08 devstack sudo[84164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:08 devstack sudo[84164]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.547s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:14:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:08 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd Apr 13 14:14:08 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:11 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd" returned: 0 in 2.985s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:11 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae0e21b-a6be-485c-a5c7-a026c98cf5cc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:11 devstack sudo[84196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:11 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:12 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.781s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:12 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54, size 1024.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:14:12 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Converted 1024.00 MB image at 342.87 MB/s Apr 13 14:14:12 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:12 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd Apr 13 14:14:12 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:13 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0478742d-d632-4aab-8bdf-be6c542741dd" released by "_copy_volume_from_snapshot" :: held 5.771s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0f7e8941-1f9f-4bdb-8eeb-399acf211942-0478742d-d632-4aab-8bdf-be6c542741dd" released by "_create_volume_from_snapshot" :: held 5.800s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.815s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ebcf234d-f65b-4a26-a28e-82cf3d87ebae tempest-GroupSnapshotsTest-343835572 None] Create group from source-snapshot-36d3409d-f82f-4ef3-b436-fba1ad1afed7 completed successfully. Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-0478742d-d632-4aab-8bdf-be6c542741dd" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0478742d-d632-4aab-8bdf-be6c542741dd" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f4152f-5569-4ac7-87ab-191c84d6b0c4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:13 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd Apr 13 14:14:13 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:14 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd" returned: 0 in 0.607s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:14 devstack sudo[84211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd Apr 13 14:14:14 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:14 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0478742d-d632-4aab-8bdf-be6c542741dd" returned: 0 in 0.626s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0478742d-d632-4aab-8bdf-be6c542741dd" released by "delete_volume" :: held 1.276s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:14 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Created reservations ['87edc58f-db58-4d2c-a321-ead560e8f5a2'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:15 devstack cinder-volume[82621]: WARNING cinder.quota [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-649733588 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-649733588, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:15 devstack cinder-volume[82621]: WARNING cinder.quota [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-649733588 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-649733588, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Created reservations ['a14f7831-ccf6-42c1-8258-14af99008647', '42ea3f3a-a713-4df2-b160-6ff60c74fb2f', '30235db6-c62f-4818-b36c-cce7fd644f2f', 'e8efb81c-0c16-4015-a096-74b0db3b956f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:15 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:15 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:15 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7846cf71-2a34-41da-8679-85208df2519c tempest-GroupSnapshotsTest-343835572 None] Delete group completed successfully. Apr 13 14:14:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] group_snapshot 36d3409d-f82f-4ef3-b436-fba1ad1afed7: deleting Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] group_snapshot 36d3409d-f82f-4ef3-b436-fba1ad1afed7: deleting {{(pid=82621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-0f7e8941-1f9f-4bdb-8eeb-399acf211942" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0f7e8941-1f9f-4bdb-8eeb-399acf211942" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Deleting offline snapshot 0f7e8941-1f9f-4bdb-8eeb-399acf211942 of volume 305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] snapshot_file for this snap is: volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b8f7a-b069-4044-bcb2-7f742db61993]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:16 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 Apr 13 14:14:16 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:16 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942" returned: 0 in 0.606s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[960981fb-38a5-4267-9861-47ea4724239c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:16 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:16 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:17 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.681s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:17 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 Apr 13 14:14:17 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:17 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942" returned: 0 in 0.574s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:17 devstack sudo[84232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942 Apr 13 14:14:17 devstack sudo[84232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:18 devstack sudo[84232]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54.0f7e8941-1f9f-4bdb-8eeb-399acf211942" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0f7e8941-1f9f-4bdb-8eeb-399acf211942" released by "_delete_snapshot" :: held 2.417s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" released by "delete_snapshot" :: held 2.436s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:18 devstack cinder-volume[82621]: WARNING cinder.quota [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-649733588 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-649733588, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:18 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] Created reservations ['494d977f-7bed-4b9a-8cb0-3fd53c3fb561', 'dce4146f-b8d9-41a4-884b-3ccd70031d3f', '214bb3ec-3188-488e-a55f-cc7890415ab0', '9f05a5e4-e37d-402d-9d39-a430af7007c1'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:18 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1d01a8ad-6644-4b31-838e-e32579323bfa tempest-GroupSnapshotsTest-343835572 None] group_snapshot 36d3409d-f82f-4ef3-b436-fba1ad1afed7: deleted successfully Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db18da2-ef29-46ad-813a-a653a48ada76]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:19 devstack sudo[84244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:19 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:19 devstack sudo[84245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:19 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:20 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.794s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:20 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.788s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:20 devstack sudo[84256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54 Apr 13 14:14:20 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Flow 'volume_create_manager' (c7bc28dc-7e78-4651-a265-3aa388ad73c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfdc8e2-3298-4d2f-a8a1-02b34ba39e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfdc8e2-3298-4d2f-a8a1-02b34ba39e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1930532089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66963ec-fec6-48a2-a76f-0f1befc3e95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28aba7831a349948f583a6fef5e3bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:21Z,use_quota=True,user_id='6ba722f8957f4818bc15dc94233dad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04255301-7d93-4cea-afa3-679d664cd4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04255301-7d93-4cea-afa3-679d664cd4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd17091-d498-490f-9ccd-c14c4da6388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd17091-d498-490f-9ccd-c14c4da6388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66963ec-fec6-48a2-a76f-0f1befc3e95d', 'volume_name': 'volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf33e437-94e7-46f2-8513-3aef7d3cf2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf33e437-94e7-46f2-8513-3aef7d3cf2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f2be46-bbd1-4629-ac58-9847502926b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:21 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Volume a66963ec-fec6-48a2-a76f-0f1befc3e95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d', 'volume_size': 1} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1930532089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66963ec-fec6-48a2-a76f-0f1befc3e95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28aba7831a349948f583a6fef5e3bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:21Z,use_quota=True,user_id='6ba722f8957f4818bc15dc94233dad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Creating volume a66963ec-fec6-48a2-a76f-0f1befc3e95d {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:21 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:21 devstack sudo[84262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d 1073741824 Apr 13 14:14:21 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:21 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" returned: 0 in 0.757s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-305ddac7-2cfe-4c97-9f4d-82bbf87e3a54" released by "delete_volume" :: held 1.622s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Created reservations ['a7bb32b5-2343-4e70-96c8-ef3e137da645'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:21 devstack cinder-volume[82621]: WARNING cinder.db.sqlalchemy.api [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-649733588'] Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Created reservations ['0024dffd-2307-4808-8c57-2d2aa86d7118', '687e42f4-9ec0-4505-bda1-230dc4ff37f3', 'b2e04e79-a2c2-4dab-b483-849f9a6e7b46', '866f48f1-6f59-4bcf-bc99-a717f20cfb7c'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:21 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:21 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:21 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d 1073741824" returned: 0 in 0.754s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:21 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d Apr 13 14:14:21 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:21 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.573s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:21 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-cef3c5db-e405-4adb-8fc2-4544a53e62c2 tempest-GroupSnapshotsTest-343835572 None] Delete group completed successfully. Apr 13 14:14:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8e8cfb3a-9f14-4b93-80bc-d0f259a7a2fd tempest-GroupSnapshotsTest-343835572 None] Group tempest-GroupSnapshotsTest-Group-2069351521: creating Apr 13 14:14:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8e8cfb3a-9f14-4b93-80bc-d0f259a7a2fd tempest-GroupSnapshotsTest-343835572 None] Group tempest-GroupSnapshotsTest-Group-2069351521: created successfully Apr 13 14:14:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8e8cfb3a-9f14-4b93-80bc-d0f259a7a2fd tempest-GroupSnapshotsTest-343835572 None] Create group completed successfully. Apr 13 14:14:22 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d" returned: 0 in 0.505s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f2be46-bbd1-4629-ac58-9847502926b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53f5e06-8a3e-4531-87a2-3a4ec525af59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:22 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Volume volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d (a66963ec-fec6-48a2-a76f-0f1befc3e95d): created successfully Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53f5e06-8a3e-4531-87a2-3a4ec525af59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Flow 'volume_create_manager' (c7bc28dc-7e78-4651-a265-3aa388ad73c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bcf5966b-7441-4859-880b-745ff7cbf60e tempest-VolumesServicesTestJSON-1057358202 None] Created volume successfully. Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Acquiring lock "cinder-a66963ec-fec6-48a2-a76f-0f1befc3e95d-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Lock "cinder-a66963ec-fec6-48a2-a76f-0f1befc3e95d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Acquiring lock "cinder-quobyte-a66963ec-fec6-48a2-a76f-0f1befc3e95d" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Lock "cinder-quobyte-a66963ec-fec6-48a2-a76f-0f1befc3e95d" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a09803a-3430-4656-b6fb-6c1e8da1ed39]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:23 devstack sudo[84280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d Apr 13 14:14:23 devstack sudo[84280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (15cacbd2-c571-42f5-a457-71a492e535ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200adc2e-42ae-4110-89b1-f3992a4d2372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200adc2e-42ae-4110-89b1-f3992a4d2372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-43201743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ac42837-a28f-459a-87ca-d2e0df76e489,host='devstack@QuobyteHD#QuobyteHD',id=efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:24Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ca93ff9-3a43-4933-a3f2-6eba40d65d3b),volume_type_id=9ca93ff9-3a43-4933-a3f2-6eba40d65d3b)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3420b3-ee9e-4563-a90a-d51181b6b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3420b3-ee9e-4563-a90a-d51181b6b99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e39497-a23c-4c45-86a2-711e6ea806f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e39497-a23c-4c45-86a2-711e6ea806f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2', 'volume_name': 'volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8bed5c-b30c-479a-a569-3087f37fcef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8bed5c-b30c-479a-a569-3087f37fcef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc5d71f-dd12-4956-bebd-d49363457eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:23 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Volume efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2', 'volume_size': 1} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ac42837-a28f-459a-87ca-d2e0df76e489,created_at=2026-04-13T12:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-43201743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ac42837-a28f-459a-87ca-d2e0df76e489,host='devstack@QuobyteHD#QuobyteHD',id=efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:24Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ca93ff9-3a43-4933-a3f2-6eba40d65d3b),volume_type_id=9ca93ff9-3a43-4933-a3f2-6eba40d65d3b)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Creating volume efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:23 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:23 devstack sudo[84283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 1073741824 Apr 13 14:14:23 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:24 devstack sudo[84280]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d" returned: 0 in 0.711s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:24 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d Apr 13 14:14:24 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:24 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 1073741824" returned: 0 in 0.700s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:24 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 Apr 13 14:14:24 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:24 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a66963ec-fec6-48a2-a76f-0f1befc3e95d" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Lock "cinder-quobyte-a66963ec-fec6-48a2-a76f-0f1befc3e95d" released by "delete_volume" :: held 1.209s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Created reservations ['2668dd65-e776-49a9-a0f7-9535465192d3', '7bb5988e-dc55-4d19-a7f6-ef8caeed68a3', '6c1e6cb0-2ea8-4206-aa69-71d43a45cc28', '827eca51-34ce-4848-b28a-71957fe2502b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:24 devstack sudo[84296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:14:24 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:24 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" returned: 0 in 0.519s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc5d71f-dd12-4956-bebd-d49363457eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0479a3-a16b-4ce4-9b8a-cae2f74d54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:24 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Volume volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 (efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2): created successfully Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0479a3-a16b-4ce4-9b8a-cae2f74d54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (15cacbd2-c571-42f5-a457-71a492e535ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:24 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-36b4b342-4948-4a69-aa8f-f7654facaef8 tempest-GroupSnapshotsTest-343835572 None] Created volume successfully. Apr 13 14:14:25 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.489s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:25 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:14:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Deleted volume successfully. Apr 13 14:14:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee0cb112-7e92-4276-a2c2-77d9536f276f tempest-VolumesServicesTestJSON-1057358202 None] Lock "cinder-a66963ec-fec6-48a2-a76f-0f1befc3e95d-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (e7afea68-1b83-4496-937b-05dc14f4a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6f48a-e9c5-4668-93d7-4be6ede2bcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6f48a-e9c5-4668-93d7-4be6ede2bcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1359693236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ac42837-a28f-459a-87ca-d2e0df76e489,host='devstack@QuobyteHD#QuobyteHD',id=74374347-5133-4f13-ab16-11996f4b2c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:26Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ca93ff9-3a43-4933-a3f2-6eba40d65d3b),volume_type_id=9ca93ff9-3a43-4933-a3f2-6eba40d65d3b)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e719d3-ce6d-4602-975c-2a14bfe9be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e719d3-ce6d-4602-975c-2a14bfe9be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5920592-4c49-4afd-aa80-8d22f097f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5920592-4c49-4afd-aa80-8d22f097f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74374347-5133-4f13-ab16-11996f4b2c88', 'volume_name': 'volume-74374347-5133-4f13-ab16-11996f4b2c88', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb648a86-f8e5-407b-9cdb-b80360369edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb648a86-f8e5-407b-9cdb-b80360369edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8ec075-37ee-4b65-8aa4-034b5f455a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:26 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Volume 74374347-5133-4f13-ab16-11996f4b2c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74374347-5133-4f13-ab16-11996f4b2c88', 'volume_size': 1} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ac42837-a28f-459a-87ca-d2e0df76e489,created_at=2026-04-13T12:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1359693236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ac42837-a28f-459a-87ca-d2e0df76e489,host='devstack@QuobyteHD#QuobyteHD',id=74374347-5133-4f13-ab16-11996f4b2c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:26Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ca93ff9-3a43-4933-a3f2-6eba40d65d3b),volume_type_id=9ca93ff9-3a43-4933-a3f2-6eba40d65d3b)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Creating volume 74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:26 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:26 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 1073741824 Apr 13 14:14:26 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:26 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 1073741824" returned: 0 in 0.606s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:26 devstack sudo[84323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 Apr 13 14:14:26 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:27 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8ec075-37ee-4b65-8aa4-034b5f455a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74374347-5133-4f13-ab16-11996f4b2c88', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565d6d5f-256a-4ce1-a624-5c1ea8f6b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:27 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Volume volume-74374347-5133-4f13-ab16-11996f4b2c88 (74374347-5133-4f13-ab16-11996f4b2c88): created successfully Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565d6d5f-256a-4ce1-a624-5c1ea8f6b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (e7afea68-1b83-4496-937b-05dc14f4a741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:27 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7d81ba8a-b51f-453b-868d-c15ff016c4f3 tempest-GroupSnapshotsTest-343835572 None] Created volume successfully. Apr 13 14:14:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-75ab117e-1e03-4639-b28e-307cc00429fb tempest-GroupSnapshotsTest-343835572 None] Update group completed successfully. Apr 13 14:14:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c0411079-fefb-4a40-a174-7d26decbff52 tempest-GroupSnapshotsTest-343835572 None] Update group completed successfully. Apr 13 14:14:30 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=148,cinder:UPDATE=147,cinder:DELETE=10,cinder:INSERT=31 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:14:30 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=143,cinder:SELECT=138,cinder:INSERT=31,cinder:DELETE=5 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:14:30 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4d9b3eee-05fa-4548-ac85-24155a132067 tempest-GroupSnapshotsTest-343835572 None] Update group completed successfully. Apr 13 14:14:31 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-99b62d93-7d58-4ba8-b52c-2ca24098dd78 tempest-GroupSnapshotsTest-343835572 None] Update group completed successfully. Apr 13 14:14:33 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] GroupSnapshot bac7162d-a9e5-49f0-8a79-42ddd399b5d3: creating. Apr 13 14:14:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Group snapshot bac7162d-a9e5-49f0-8a79-42ddd399b5d3: creating. {{(pid=82621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 14:14:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Creating offline snapshot 320fc846-4121-46a3-894e-b6738abbd9b8 of volume efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:14:33 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4245a40-332a-47e3-b4df-c19401532ec3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:33 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 Apr 13 14:14:33 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:34 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" returned: 0 in 0.993s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:34 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 1G Apr 13 14:14:34 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:36 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 1G" returned: 0 in 1.431s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:36 devstack sudo[84484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 Apr 13 14:14:36 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:37 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8" returned: 0 in 1.060s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:37 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:37 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 Apr 13 14:14:37 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:38 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8" returned: 0 in 0.886s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:38 devstack sudo[84494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info Apr 13 14:14:38 devstack sudo[84494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:39 devstack sudo[84494]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info" returned: 0 in 1.158s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:39 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:39 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info Apr 13 14:14:39 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Flow 'volume_create_manager' (14a06f16-7e2d-4b0f-bfe5-2ba3861da0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba710f42-1ad7-40ce-88c2-dad4367f3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba710f42-1ad7-40ce-88c2-dad4367f3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1025465823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8875897a-5705-4416-b379-d4b3e7bcdd7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3a7d242f814d8782eac34ada490cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:40Z,use_quota=True,user_id='27d663ca4f56442489ab441ef5b7908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c1978-2f86-492b-a282-5d41c9f60a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:40 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c1978-2f86-492b-a282-5d41c9f60a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf624153-a6cc-4fda-adf5-b1a324853ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.image.glance [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Creating Keystone auth plugin from conf {{(pid=82621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.info" returned: 0 in 0.898s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.580s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Creating offline snapshot e0c837e3-9ce3-4033-b5ff-ff0859e89c88 of volume 74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d245ab-123d-4270-b903-9366601a9cb6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:40 devstack sudo[84535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 Apr 13 14:14:40 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf624153-a6cc-4fda-adf5-b1a324853ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8875897a-5705-4416-b379-d4b3e7bcdd7d', 'volume_name': 'volume-8875897a-5705-4416-b379-d4b3e7bcdd7d', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4c3abf-80ec-45eb-84f7-dec4218c2f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4c3abf-80ec-45eb-84f7-dec4218c2f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539038c7-97b3-4f38-836a-53f974ce658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Volume 8875897a-5705-4416-b379-d4b3e7bcdd7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8875897a-5705-4416-b379-d4b3e7bcdd7d', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 14:14:40 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Trying to clone 8875897a-5705-4416-b379-d4b3e7bcdd7d from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]). {{(pid=82621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 14:14:41 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Image download 20.69 MB at 20.69 MB/s Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738c23b-cd15-4525-b9b5-abdfe61bc0ac]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:41 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD Apr 13 14:14:41 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:41 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88" returned: 0 in 1.059s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:41 devstack sudo[84564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 1G Apr 13 14:14:41 devstack sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:41 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:41 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 is fetched for user 27d663ca4f56442489ab441ef5b7908b. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 14:14:42 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[828444ed-7d11-400c-bf75-d75475cd09d0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:42 devstack sudo[84597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD Apr 13 14:14:42 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:42 devstack sudo[84564]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 1G" returned: 0 in 1.165s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74374347-5133-4f13-ab16-11996f4b2c88 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:42 devstack sudo[84605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74374347-5133-4f13-ab16-11996f4b2c88 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 Apr 13 14:14:42 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:42 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:43 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74374347-5133-4f13-ab16-11996f4b2c88 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88" returned: 0 in 0.830s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:43 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:43 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 Apr 13 14:14:43 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:43 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88" returned: 0 in 0.540s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:43 devstack sudo[84665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info Apr 13 14:14:43 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:44 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info" returned: 0 in 0.477s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:44 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:44 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info Apr 13 14:14:44 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:44 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.info" returned: 0 in 0.534s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.709s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1025465823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8875897a-5705-4416-b379-d4b3e7bcdd7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3a7d242f814d8782eac34ada490cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:40Z,use_quota=True,user_id='27d663ca4f56442489ab441ef5b7908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Creating volume 8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:44 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:44 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d 1073741824 Apr 13 14:14:44 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-be7a8fc2-f952-4b9b-94f9-a58e74f4c872 tempest-GroupSnapshotsTest-343835572 None] group_snapshot bac7162d-a9e5-49f0-8a79-42ddd399b5d3: created successfully Apr 13 14:14:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] group_snapshot bac7162d-a9e5-49f0-8a79-42ddd399b5d3: deleting Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] group_snapshot bac7162d-a9e5-49f0-8a79-42ddd399b5d3: deleting {{(pid=82621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-320fc846-4121-46a3-894e-b6738abbd9b8" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-320fc846-4121-46a3-894e-b6738abbd9b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Deleting offline snapshot 320fc846-4121-46a3-894e-b6738abbd9b8 of volume efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] snapshot_file for this snap is: volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a30ac-cff8-4936-871b-473c0662ca0a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:45 devstack sudo[84677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 Apr 13 14:14:45 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:45 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d 1073741824" returned: 0 in 0.925s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:45 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:14:45 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:46 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8" returned: 0 in 0.673s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf54c4b9-b8c9-4c71-85c5-e67e6283e0db]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:46 devstack sudo[84684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 Apr 13 14:14:46 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:46 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 0 in 0.724s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Attempting download of c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume 8875897a-5705-4416-b379-d4b3e7bcdd7d. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a244b-cf8a-4c12-82ee-8afd96732823]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:46 devstack sudo[84687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim Apr 13 14:14:46 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:47 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" returned: 0 in 1.135s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:47 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 Apr 13 14:14:47 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:48 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim" returned: 0 in 1.438s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:48 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim Apr 13 14:14:48 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:48 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim" returned: 1 in 0.638s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_go5mjjim' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb00be3-5383-4f8f-8045-bc1fdedf982b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:48 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8" returned: 0 in 1.304s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:48 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8 Apr 13 14:14:48 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:48 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD Apr 13 14:14:48 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:49 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] c223e7fa-335f-4690-8d1c-349d8cc0aad3 was qcow2, converting to raw {{(pid=82621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:49 devstack sudo[84747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:14:49 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:49 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2.320fc846-4121-46a3-894e-b6738abbd9b8" returned: 0 in 0.820s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-320fc846-4121-46a3-894e-b6738abbd9b8" released by "_delete_snapshot" :: held 4.029s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" released by "delete_snapshot" :: held 4.050s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-74374347-5133-4f13-ab16-11996f4b2c88" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-74374347-5133-4f13-ab16-11996f4b2c88" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-e0c837e3-9ce3-4033-b5ff-ff0859e89c88" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-e0c837e3-9ce3-4033-b5ff-ff0859e89c88" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Deleting offline snapshot e0c837e3-9ce3-4033-b5ff-ff0859e89c88 of volume 74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] snapshot_file for this snap is: volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[567e392b-04e9-490c-8c96-71e18cc968ba]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:49 devstack sudo[84750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 Apr 13 14:14:49 devstack sudo[84750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:50 devstack sudo[84750]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88" returned: 0 in 0.820s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74374347-5133-4f13-ab16-11996f4b2c88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfdb7c2-0fac-426e-a8ae-6783eedebb78]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:50 devstack sudo[84771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 Apr 13 14:14:50 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Flow 'volume_create_manager' (1680884d-987a-4a51-a945-cfd4d60b78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4377161b-4994-487a-bba5-748097d01ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4377161b-4994-487a-bba5-748097d01ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1875633333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b36ede-bfe4-4b19-8dd4-8028411fab75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a22c32230c84194818e2fb947d225f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:51Z,use_quota=True,user_id='9d7ff2fe5eec4cdbaf7b00c7630342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe36f43d-d903-49b4-a3fe-ca7aa158de85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe36f43d-d903-49b4-a3fe-ca7aa158de85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d684e2a5-36a5-4a41-ad1b-5c35819be735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d684e2a5-36a5-4a41-ad1b-5c35819be735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b36ede-bfe4-4b19-8dd4-8028411fab75', 'volume_name': 'volume-73b36ede-bfe4-4b19-8dd4-8028411fab75', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f0a25a-55a1-47f8-8f72-1536df6dd6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f0a25a-55a1-47f8-8f72-1536df6dd6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287a3028-09f2-4fda-ab88-bd3220928075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:50 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Volume 73b36ede-bfe4-4b19-8dd4-8028411fab75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b36ede-bfe4-4b19-8dd4-8028411fab75', 'volume_size': 1} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1875633333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b36ede-bfe4-4b19-8dd4-8028411fab75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a22c32230c84194818e2fb947d225f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:51Z,use_quota=True,user_id='9d7ff2fe5eec4cdbaf7b00c7630342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Creating volume 73b36ede-bfe4-4b19-8dd4-8028411fab75 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:50 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:51 devstack sudo[84773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 1073741824 Apr 13 14:14:51 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:51 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88" returned: 0 in 1.079s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:51 devstack sudo[84781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 Apr 13 14:14:51 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:52 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 1073741824" returned: 0 in 1.184s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:52 devstack sudo[84783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 Apr 13 14:14:52 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:52 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 0 in 3.067s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_fuuplc4ldevstack@QuobyteHD, size 112.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:14:52 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Converted 112.00 MB image at 36.50 MB/s Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:52 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88" returned: 0 in 0.856s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:52 devstack sudo[84789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88 Apr 13 14:14:52 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:52 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d 1G Apr 13 14:14:52 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:52 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75" returned: 0 in 0.720s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287a3028-09f2-4fda-ab88-bd3220928075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b36ede-bfe4-4b19-8dd4-8028411fab75', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df803d2c-991c-43eb-bcb9-ed25e9987a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:52 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Volume volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 (73b36ede-bfe4-4b19-8dd4-8028411fab75): created successfully Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df803d2c-991c-43eb-bcb9-ed25e9987a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Flow 'volume_create_manager' (1680884d-987a-4a51-a945-cfd4d60b78d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ef748f76-5073-4683-9aca-8625adc770a2 tempest-ServerRescueNegativeTestJSON-797650764 None] Created volume successfully. Apr 13 14:14:53 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88.e0c837e3-9ce3-4033-b5ff-ff0859e89c88" returned: 0 in 0.535s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-e0c837e3-9ce3-4033-b5ff-ff0859e89c88" released by "_delete_snapshot" :: held 3.460s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-74374347-5133-4f13-ab16-11996f4b2c88" released by "delete_snapshot" :: held 3.476s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:53 devstack cinder-volume[82621]: WARNING cinder.quota [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1964014431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1964014431, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:53 devstack cinder-volume[82621]: WARNING cinder.quota [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1964014431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1964014431, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Created reservations ['de37c783-5012-49f3-85a5-f1c5db07a72f', '4e340306-1ef0-4165-b270-e5d2a84263ad', '186fd6be-9def-42a0-8fe3-a1a39f381e8b', '39ff5b55-44b3-4a02-8b1a-e2b1b150c5e8'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] Created reservations ['d29f2b2e-650f-47e5-a6db-5a494278901c', '819c0ba2-fb20-4ebb-834a-7d7df933e10d', '461165ea-5fda-4012-bfc7-aa7f2be6e3da', 'e1fab982-f433-4065-81a5-75797cba65d6'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:14:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-514ac843-0be2-47d7-bb95-01bb977abdfd tempest-GroupSnapshotsTest-343835572 None] group_snapshot bac7162d-a9e5-49f0-8a79-42ddd399b5d3: deleted successfully Apr 13 14:14:53 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d 1G" returned: 0 in 0.905s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea725c1-ce91-42d8-982d-6519c5eb223f]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:53 devstack sudo[84797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:14:53 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:54 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 0 in 0.593s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:54 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:14:54 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-74374347-5133-4f13-ab16-11996f4b2c88" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-74374347-5133-4f13-ab16-11996f4b2c88" acquired by "delete_volume" :: waited 0.043s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:54 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87309bd-10b6-4349-8f25-5b854012a675]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:55 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 Apr 13 14:14:55 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:55 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 1 in 1.020s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Downloaded image c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume 8875897a-5705-4416-b379-d4b3e7bcdd7d successfully. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 for user 27d663ca4f56442489ab441ef5b7908b is deleted. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Marking volume 8875897a-5705-4416-b379-d4b3e7bcdd7d as bootable. {{(pid=82621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Copying metadata from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 to 8875897a-5705-4416-b379-d4b3e7bcdd7d. {{(pid=82621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Creating volume glance metadata for volume 8875897a-5705-4416-b379-d4b3e7bcdd7d backed by image c223e7fa-335f-4690-8d1c-349d8cc0aad3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539038c7-97b3-4f38-836a-53f974ce658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8875897a-5705-4416-b379-d4b3e7bcdd7d', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6de445-ae1d-4f96-8898-257550ff6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:55 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Volume volume-8875897a-5705-4416-b379-d4b3e7bcdd7d (8875897a-5705-4416-b379-d4b3e7bcdd7d): created successfully Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6de445-ae1d-4f96-8898-257550ff6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Flow 'volume_create_manager' (14a06f16-7e2d-4b0f-bfe5-2ba3861da0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-331d40f1-6477-4a92-b2dd-2a19edf1c948 tempest-VolumesImageMetadata-1894488816 None] Created volume successfully. Apr 13 14:14:56 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88" returned: 0 in 1.317s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:56 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88 Apr 13 14:14:56 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Flow 'volume_create_manager' (5c0c7679-a79c-41b8-bee5-e99e5bc8933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7deb23-1e5d-48f0-89aa-5930dc9f7e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7deb23-1e5d-48f0-89aa-5930dc9f7e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:57Z,deleted=False,deleted_at=None,display_description='',display_name='835751d1-d534-4624-973a-98f09c6b0565-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db932b3-0091-40b4-bb2e-b290d10792bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b92e4c6738a43c7b366b1543ed3832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:57Z,use_quota=True,user_id='1addeb502dc8432d8a0084951ace2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f85cf-df08-44c2-8bfa-c6f16521a201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f85cf-df08-44c2-8bfa-c6f16521a201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a251594e-14ee-46fc-85b4-582138ff1c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a251594e-14ee-46fc-85b4-582138ff1c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db932b3-0091-40b4-bb2e-b290d10792bd', 'volume_name': 'volume-7db932b3-0091-40b4-bb2e-b290d10792bd', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c61463-570c-4b8a-96ba-d9b5f1b1b3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c61463-570c-4b8a-96ba-d9b5f1b1b3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e752fc0-b056-47c4-80b1-c3cc61b50581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:14:57 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Volume 7db932b3-0091-40b4-bb2e-b290d10792bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db932b3-0091-40b4-bb2e-b290d10792bd', 'volume_size': 1} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:14:57Z,deleted=False,deleted_at=None,display_description='',display_name='835751d1-d534-4624-973a-98f09c6b0565-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db932b3-0091-40b4-bb2e-b290d10792bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b92e4c6738a43c7b366b1543ed3832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:14:57Z,use_quota=True,user_id='1addeb502dc8432d8a0084951ace2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Creating volume 7db932b3-0091-40b4-bb2e-b290d10792bd {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:14:57 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Acquiring lock "cinder-8875897a-5705-4416-b379-d4b3e7bcdd7d-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Lock "cinder-8875897a-5705-4416-b379-d4b3e7bcdd7d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:57 devstack sudo[84819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd 1073741824 Apr 13 14:14:57 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Acquiring lock "cinder-quobyte-8875897a-5705-4416-b379-d4b3e7bcdd7d" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Lock "cinder-quobyte-8875897a-5705-4416-b379-d4b3e7bcdd7d" acquired by "delete_volume" :: waited 0.043s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d8d6f-8e60-43dc-a6a0-86950e251abc]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:57 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-74374347-5133-4f13-ab16-11996f4b2c88" returned: 0 in 1.662s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-74374347-5133-4f13-ab16-11996f4b2c88" released by "delete_volume" :: held 3.179s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" acquired by "delete_volume" :: waited 0.024s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:14:57 devstack sudo[84822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:14:57 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:57 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9fd6e9-8559-4618-8813-2f052d39a459]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:14:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:58 devstack sudo[84824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 Apr 13 14:14:58 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:59 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 0 in 1.279s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:59 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd 1073741824" returned: 0 in 1.616s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:59 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd Apr 13 14:14:59 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:59 devstack sudo[84859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:14:59 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:14:59 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root Apr 13 14:14:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" returned: 0 in 1.580s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:14:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:14:59 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2 Apr 13 14:14:59 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:00 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" returned: 0 in 0.635s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-efc8cfb5-5f65-41f3-9afd-1dcf92c8f1c2" released by "delete_volume" :: held 2.299s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Created reservations ['3cc7d7f1-747c-4672-a0af-73347e5e70e8'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:00 devstack cinder-volume[82621]: WARNING cinder.quota [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1964014431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1964014431, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Created reservations ['2a1fc61f-eaa4-440c-bbc9-cca05f2dbba7', '0373ff42-6c8a-4df2-81e6-49b251f13a0d', '52f5062b-07c4-48d9-b312-6417f523bafc', 'c06ce66b-9c8c-423f-89d9-0503b9b9e13f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Created reservations ['7c582a70-d5eb-44e8-8228-11d547c59524', '86fb1522-5785-41a9-949f-231651166d06', '6fc757d6-7dba-468d-85be-ba9a874070e9', 'a71df04c-a6c1-4f2b-b7b3-1ea9982dc00a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:00 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd" returned: 0 in 1.371s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] <== create_volume: return (3050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.057s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e752fc0-b056-47c4-80b1-c3cc61b50581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db932b3-0091-40b4-bb2e-b290d10792bd', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af29c846-c3f6-473e-b4cf-8285bd31fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:00 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Volume volume-7db932b3-0091-40b4-bb2e-b290d10792bd (7db932b3-0091-40b4-bb2e-b290d10792bd): created successfully Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af29c846-c3f6-473e-b4cf-8285bd31fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Flow 'volume_create_manager' (5c0c7679-a79c-41b8-bee5-e99e5bc8933f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:00 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-b6d8f144-1c20-4261-8ebf-25c88578d106 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Created volume successfully. Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:00 devstack sudo[84881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:00 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:00 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 1 in 1.656s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:15:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:00 devstack sudo[84883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d Apr 13 14:15:00 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:01 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.686s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:01 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8875897a-5705-4416-b379-d4b3e7bcdd7d" returned: 0 in 0.608s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7b8e86f8-d523-4da9-80d7-7de131c0c79b tempest-GroupSnapshotsTest-343835572 None] Delete group completed successfully. Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Lock "cinder-quobyte-8875897a-5705-4416-b379-d4b3e7bcdd7d" released by "delete_volume" :: held 3.639s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Created reservations ['28e736c1-ce8c-466c-ab03-005c6347f662', '814e4b07-1a78-4dba-9c7b-366b6bfaffb8', '009754e9-a645-404c-abbf-bb7ea6c67a2c', 'e4b8e550-b722-453a-8674-058a0c6ccda8'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:01 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:01 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:01 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Deleted volume successfully. Apr 13 14:15:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-61141084-e194-4e82-a4b8-dc0cf005976f tempest-VolumesImageMetadata-1894488816 None] Lock "cinder-8875897a-5705-4416-b379-d4b3e7bcdd7d-delete_volume" released by "delete_volume" :: held 4.350s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b024e939-a749-4b59-b931-a18f65f5b585 tempest-GroupSnapshotsTest-343835572 None] Group tempest-GroupSnapshotsTest-Group-1869909768: creating Apr 13 14:15:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b024e939-a749-4b59-b931-a18f65f5b585 tempest-GroupSnapshotsTest-343835572 None] Group tempest-GroupSnapshotsTest-Group-1869909768: created successfully Apr 13 14:15:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b024e939-a749-4b59-b931-a18f65f5b585 tempest-GroupSnapshotsTest-343835572 None] Create group completed successfully. Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (2562017c-04bd-4142-aec0-d34dbc241cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46cbf49-9366-4c66-b2f3-8cdece78705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46cbf49-9366-4c66-b2f3-8cdece78705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957666021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fadba7c-0c00-4dab-a649-a7667eab0e9d,host='devstack@QuobyteHD#QuobyteHD',id=0510a929-25cd-43db-ab87-9a3b06b688c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:03Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8265b74-2d27-4807-98c2-794c27875167),volume_type_id=b8265b74-2d27-4807-98c2-794c27875167)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44a0f06-c495-430b-ae53-08dd8a120efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44a0f06-c495-430b-ae53-08dd8a120efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ed1f5-3053-415d-a917-a733738b5410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ed1f5-3053-415d-a917-a733738b5410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0510a929-25cd-43db-ab87-9a3b06b688c0', 'volume_name': 'volume-0510a929-25cd-43db-ab87-9a3b06b688c0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948dc255-c708-4945-895d-2bf7b5a857e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948dc255-c708-4945-895d-2bf7b5a857e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678f785b-06f9-4fd2-b1b6-d4bd0ff83478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:03 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Volume 0510a929-25cd-43db-ab87-9a3b06b688c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0510a929-25cd-43db-ab87-9a3b06b688c0', 'volume_size': 1} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fadba7c-0c00-4dab-a649-a7667eab0e9d,created_at=2026-04-13T12:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957666021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fadba7c-0c00-4dab-a649-a7667eab0e9d,host='devstack@QuobyteHD#QuobyteHD',id=0510a929-25cd-43db-ab87-9a3b06b688c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a1124c93c24c8fa12298db3390f508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:03Z,use_quota=True,user_id='076543b3b45946eeb45f8fac536dd412',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8265b74-2d27-4807-98c2-794c27875167),volume_type_id=b8265b74-2d27-4807-98c2-794c27875167)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Creating volume 0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:03 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:03 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 1073741824 Apr 13 14:15:03 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:04 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 1073741824" returned: 0 in 1.060s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:04 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 Apr 13 14:15:04 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:05 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0" returned: 0 in 0.803s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.363s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678f785b-06f9-4fd2-b1b6-d4bd0ff83478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0510a929-25cd-43db-ab87-9a3b06b688c0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd5141-52aa-4a3f-8eaf-3c58e5802066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a43d3-c877-423f-9f08-33537105da6c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:05 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Volume volume-0510a929-25cd-43db-ab87-9a3b06b688c0 (0510a929-25cd-43db-ab87-9a3b06b688c0): created successfully Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbd5141-52aa-4a3f-8eaf-3c58e5802066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Flow 'volume_create_manager' (2562017c-04bd-4142-aec0-d34dbc241cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:05 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7348254e-8e78-49f0-887a-7da266161750 tempest-GroupSnapshotsTest-343835572 None] Created volume successfully. Apr 13 14:15:05 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd Apr 13 14:15:05 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] GroupSnapshot 9630f88a-c867-4788-88b6-b762dd6c4eef: creating. Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Group snapshot 9630f88a-c867-4788-88b6-b762dd6c4eef: creating. {{(pid=82621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:06 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd" returned: 0 in 1.097s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.152s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.339s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Creating offline snapshot 2974bef9-b2b4-40a0-8ea1-15d4e70bed25 of volume 0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99896620-99bc-454b-90a9-4f54069d8cc3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1', 'name': 'volume-7db932b3-0091-40b4-bb2e-b290d10792bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6559ec73-c95b-4564-9b7f-19ef6df2f111', 'enforce_multipath': True} {{(pid=82621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 14:15:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-7a495171-a0d4-41b7-b034-39bae87102fc req-ac56e076-874e-40a9-a445-7198f035245a tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] attachment_update completed successfully. Apr 13 14:15:07 devstack sudo[84965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 Apr 13 14:15:07 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Flow 'volume_create_manager' (4ba1fd89-7e99-4ca4-9f6c-7874bd568744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4419b76c-42cf-49b4-87d4-6a01f79db9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4419b76c-42cf-49b4-87d4-6a01f79db9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-383587169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe041c7d-270d-453e-bbf4-89981c97ed3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b573e2757a74dfca926dcf29e0e5d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:07Z,use_quota=True,user_id='7fd7c95489984f58ad283f53cbfb555f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5b41fa-e438-4e28-8139-6e531709d939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5b41fa-e438-4e28-8139-6e531709d939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8285966f-3499-4b27-a3a6-9d9c503237c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8285966f-3499-4b27-a3a6-9d9c503237c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe041c7d-270d-453e-bbf4-89981c97ed3f', 'volume_name': 'volume-fe041c7d-270d-453e-bbf4-89981c97ed3f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f756b4fa-e360-4ca2-8309-b1ea1a7243d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f756b4fa-e360-4ca2-8309-b1ea1a7243d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad8ad49-a2d2-43c2-9e1a-6570d906921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:07 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Volume fe041c7d-270d-453e-bbf4-89981c97ed3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe041c7d-270d-453e-bbf4-89981c97ed3f', 'volume_size': 1} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:07 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0" returned: 0 in 0.883s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:07 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 1G Apr 13 14:15:07 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:08 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 1G" returned: 0 in 0.766s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0510a929-25cd-43db-ab87-9a3b06b688c0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:08 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0510a929-25cd-43db-ab87-9a3b06b688c0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 Apr 13 14:15:08 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:09 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0510a929-25cd-43db-ab87-9a3b06b688c0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25" returned: 0 in 0.618s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:09 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:15:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:09 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 Apr 13 14:15:09 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25" returned: 0 in 0.632s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:09 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:09 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info Apr 13 14:15:09 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:10 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info" returned: 0 in 0.685s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:10 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:15:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:10 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info Apr 13 14:15:10 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:11 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.info" returned: 0 in 0.749s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.818s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-383587169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe041c7d-270d-453e-bbf4-89981c97ed3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b573e2757a74dfca926dcf29e0e5d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:07Z,use_quota=True,user_id='7fd7c95489984f58ad283f53cbfb555f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Creating volume fe041c7d-270d-453e-bbf4-89981c97ed3f {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:11 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:11 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f 1073741824 Apr 13 14:15:11 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b31f9083-f4cc-4233-a0c2-c38ab5b2afd7 tempest-GroupSnapshotsTest-343835572 None] group_snapshot 9630f88a-c867-4788-88b6-b762dd6c4eef: created successfully Apr 13 14:15:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] group_snapshot 9630f88a-c867-4788-88b6-b762dd6c4eef: deleting Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] group_snapshot 9630f88a-c867-4788-88b6-b762dd6c4eef: deleting {{(pid=82621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-0510a929-25cd-43db-ab87-9a3b06b688c0" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0510a929-25cd-43db-ab87-9a3b06b688c0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-2974bef9-b2b4-40a0-8ea1-15d4e70bed25" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-2974bef9-b2b4-40a0-8ea1-15d4e70bed25" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Deleting offline snapshot 2974bef9-b2b4-40a0-8ea1-15d4e70bed25 of volume 0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] snapshot_file for this snap is: volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881add9-9268-46b9-8c90-0c8eadaa6f2e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:12 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 Apr 13 14:15:12 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:12 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f 1073741824" returned: 0 in 1.240s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:12 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f Apr 13 14:15:12 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Acquiring lock "cinder-73b36ede-bfe4-4b19-8dd4-8028411fab75-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "cinder-73b36ede-bfe4-4b19-8dd4-8028411fab75-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Acquiring lock "cinder-quobyte-73b36ede-bfe4-4b19-8dd4-8028411fab75" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "cinder-quobyte-73b36ede-bfe4-4b19-8dd4-8028411fab75" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd130d0-5ac5-4811-a0e3-5d20fdc67c01]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:13 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 Apr 13 14:15:13 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:13 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25" returned: 0 in 1.637s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0510a929-25cd-43db-ab87-9a3b06b688c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd0682-69ec-499e-882b-ce3756ad6e11]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:13 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f" returned: 0 in 1.235s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] <== create_volume: return (2537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.539s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad8ad49-a2d2-43c2-9e1a-6570d906921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe041c7d-270d-453e-bbf4-89981c97ed3f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87580e52-c830-4250-86ff-5d6ffced2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Volume volume-fe041c7d-270d-453e-bbf4-89981c97ed3f (fe041c7d-270d-453e-bbf4-89981c97ed3f): created successfully Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87580e52-c830-4250-86ff-5d6ffced2639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Flow 'volume_create_manager' (4ba1fd89-7e99-4ca4-9f6c-7874bd568744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5da20e96-9e5d-4ffd-a65a-80fa1c544b43 tempest-VolumesTransfersTest-1269581436 None] Created volume successfully. Apr 13 14:15:13 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 Apr 13 14:15:13 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:14 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75" returned: 0 in 1.237s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:14 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75 Apr 13 14:15:14 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:14 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0" returned: 0 in 1.196s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:14 devstack sudo[85477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 Apr 13 14:15:14 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9c21a1b2-addf-4fe9-8b43-f8f2cb2fcc1a tempest-VolumesTransfersTest-2103722318 None] Transfer volume completed successfully. Apr 13 14:15:15 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-73b36ede-bfe4-4b19-8dd4-8028411fab75" returned: 0 in 1.011s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "cinder-quobyte-73b36ede-bfe4-4b19-8dd4-8028411fab75" released by "delete_volume" :: held 2.359s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Created reservations ['536a824b-973e-42a2-974c-a45b84addb85', '17895c30-3903-4c17-bcaf-164008216bed', '0bed172e-3c6e-4d04-998f-8bff123688eb', '6bbfeb98-3b09-46b6-ad8e-060f1d36ccaf'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:15 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:15 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:15 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25" returned: 0 in 1.133s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:16 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25 Apr 13 14:15:16 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:16 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.572s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Deleted volume successfully. Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3618bacc-b922-4df1-a075-990b1be82db2 tempest-ServerRescueNegativeTestJSON-797650764 None] Lock "cinder-73b36ede-bfe4-4b19-8dd4-8028411fab75-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Acquiring lock "cinder-fe041c7d-270d-453e-bbf4-89981c97ed3f-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-fe041c7d-270d-453e-bbf4-89981c97ed3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Acquiring lock "cinder-quobyte-fe041c7d-270d-453e-bbf4-89981c97ed3f" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-quobyte-fe041c7d-270d-453e-bbf4-89981c97ed3f" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143e0e3-a5b4-4587-8be8-50846ee64a56]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:16 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f Apr 13 14:15:16 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:17 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0.2974bef9-b2b4-40a0-8ea1-15d4e70bed25" returned: 0 in 1.227s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-2974bef9-b2b4-40a0-8ea1-15d4e70bed25" released by "_delete_snapshot" :: held 5.554s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0510a929-25cd-43db-ab87-9a3b06b688c0" released by "delete_snapshot" :: held 5.572s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:17 devstack cinder-volume[82621]: WARNING cinder.quota [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-631378999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-631378999, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:15:17 devstack cinder-volume[82621]: WARNING cinder.quota [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-631378999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-631378999, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:15:17 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] Created reservations ['339d36f9-83c9-4e22-b518-972aca783646', '668c08c5-0c33-4342-adfb-1b4a1a68376e', '0496932f-4e4a-44da-9e59-8ee1e494fd78', '6e4473f9-9b04-4550-a0ac-d7110f381687'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:17 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-68fc4b7b-839e-4bd7-9827-860433e1a87e tempest-GroupSnapshotsTest-343835572 None] group_snapshot 9630f88a-c867-4788-88b6-b762dd6c4eef: deleted successfully Apr 13 14:15:17 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f" returned: 0 in 1.160s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:17 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f Apr 13 14:15:17 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:18 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fe041c7d-270d-453e-bbf4-89981c97ed3f" returned: 0 in 0.816s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-quobyte-fe041c7d-270d-453e-bbf4-89981c97ed3f" released by "delete_volume" :: held 2.114s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Created reservations ['c73d7f0b-08c2-4c3f-b66b-01fa47523928', '7432f14d-2998-4b47-85ca-127866c415b6', '762a60a5-f2e4-4bda-9b99-af0fd2b01c7d', '49448db3-1855-4deb-9ad7-b50637da6cca'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "cinder-quobyte-0510a929-25cd-43db-ab87-9a3b06b688c0" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0510a929-25cd-43db-ab87-9a3b06b688c0" acquired by "delete_volume" :: waited 0.028s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b4afc5-2e6e-41e4-a647-b2bffbe2ad9f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:19 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 Apr 13 14:15:19 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:19 devstack sudo[85529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:19 devstack sudo[85529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.186s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:19 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:19 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:19 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0" returned: 0 in 1.057s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:19 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0 Apr 13 14:15:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Flow 'volume_create_manager' (d57c78c9-2858-4f09-8345-652cc6770de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:19 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be677551-f461-4dab-97bb-051d1af31974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be677551-f461-4dab-97bb-051d1af31974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1980708842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2686210-3fa5-495d-b572-d53a1f46b40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b573e2757a74dfca926dcf29e0e5d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:20Z,use_quota=True,user_id='7fd7c95489984f58ad283f53cbfb555f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c1cb6b-46e8-4dc5-9dd5-1b56c9e5ae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c1cb6b-46e8-4dc5-9dd5-1b56c9e5ae07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053df57f-4bb1-40dc-8f16-fa57f1ddb1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:20 devstack sudo[85529]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053df57f-4bb1-40dc-8f16-fa57f1ddb1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2686210-3fa5-495d-b572-d53a1f46b40b', 'volume_name': 'volume-b2686210-3fa5-495d-b572-d53a1f46b40b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd00b6fb-9257-4ab3-9a9c-e123249c7ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd00b6fb-9257-4ab3-9a9c-e123249c7ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dc50ea-d71d-4986-b279-46ec56524c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:20 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Volume b2686210-3fa5-495d-b572-d53a1f46b40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2686210-3fa5-495d-b572-d53a1f46b40b', 'volume_size': 1} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1980708842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2686210-3fa5-495d-b572-d53a1f46b40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b573e2757a74dfca926dcf29e0e5d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:20Z,use_quota=True,user_id='7fd7c95489984f58ad283f53cbfb555f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Creating volume b2686210-3fa5-495d-b572-d53a1f46b40b {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:20 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 1.218s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:20 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b 1073741824 Apr 13 14:15:20 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Deleted volume successfully. Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a02f02f7-a644-4014-b45a-bb2b531a9e2c tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-fe041c7d-270d-453e-bbf4-89981c97ed3f-delete_volume" released by "delete_volume" :: held 3.885s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:20 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 1.084s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:20 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0510a929-25cd-43db-ab87-9a3b06b688c0" returned: 0 in 0.961s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Lock "cinder-quobyte-0510a929-25cd-43db-ab87-9a3b06b688c0" released by "delete_volume" :: held 2.156s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:20 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Created reservations ['10d81a9c-05a0-4142-8ab2-28508fa085f9'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:20 devstack cinder-volume[82621]: WARNING cinder.quota [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-631378999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-631378999, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Created reservations ['74977469-1e39-41e4-b2df-1e5632d8832d', '06c5d198-6f57-4a38-bca8-a9abd9b0b87c', 'cea744cc-c8f5-4f7f-bbbb-0811825554d3', '5a4eeb29-2098-41b6-a45c-85c0ffc45ac4'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:21 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b 1073741824" returned: 0 in 0.909s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:21 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b Apr 13 14:15:21 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:21 devstack sudo[85551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:21 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:21 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b" returned: 0 in 0.468s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dc50ea-d71d-4986-b279-46ec56524c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2686210-3fa5-495d-b572-d53a1f46b40b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf95575-e7d1-4f64-9138-b102e4d75e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:21 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Volume volume-b2686210-3fa5-495d-b572-d53a1f46b40b (b2686210-3fa5-495d-b572-d53a1f46b40b): created successfully Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf95575-e7d1-4f64-9138-b102e4d75e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Flow 'volume_create_manager' (d57c78c9-2858-4f09-8345-652cc6770de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a899981a-784d-4ad0-99ef-62ae0ca2e2aa tempest-VolumesTransfersTest-1269581436 None] Created volume successfully. Apr 13 14:15:21 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.527s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0447d4d9-b478-4dc1-b51e-a13dbc85a505 tempest-GroupSnapshotsTest-343835572 None] Delete group completed successfully. Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Acquiring lock "cinder-b2686210-3fa5-495d-b572-d53a1f46b40b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-b2686210-3fa5-495d-b572-d53a1f46b40b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Acquiring lock "cinder-quobyte-b2686210-3fa5-495d-b572-d53a1f46b40b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-quobyte-b2686210-3fa5-495d-b572-d53a1f46b40b" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba33e7e-ff98-40f8-a965-37b0516c1ea8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:22 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b Apr 13 14:15:22 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:22 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b" returned: 0 in 0.556s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:22 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b Apr 13 14:15:22 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:23 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2686210-3fa5-495d-b572-d53a1f46b40b" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-quobyte-b2686210-3fa5-495d-b572-d53a1f46b40b" released by "delete_volume" :: held 1.109s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Created reservations ['848cf44b-fc88-44d4-ac59-5bcbb59ac12c', '1f0eb900-fcf9-43fa-88f7-6237410595e4', '443bb433-17ba-478e-abfc-dc67639c84f7', '029c7cbf-15fb-42fe-82d1-cf9597b0ea36'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:23 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:23 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:23 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Deleted volume successfully. Apr 13 14:15:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6dc46c9d-43d2-4ca8-ae04-3d0a7e9fbe86 tempest-VolumesTransfersTest-1541037436 None] Lock "cinder-b2686210-3fa5-495d-b572-d53a1f46b40b-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Flow 'volume_create_manager' (334e022f-bee4-40ff-832b-187de656de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dab1703-8bf8-4d5d-8291-e67f97b84894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dab1703-8bf8-4d5d-8291-e67f97b84894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1096852214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b8baba-bdbe-4aee-acb4-9f33b78a41c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4264fd7b8bb340d99af0356cc7ef7134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:31Z,use_quota=True,user_id='95f8a1ba431040de907c4ebd13f7a15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5e8b74-12c9-41b5-8b94-5e9ef086f57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5e8b74-12c9-41b5-8b94-5e9ef086f57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b9b48-3be9-46f0-a9c4-b3e0841ba8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b9b48-3be9-46f0-a9c4-b3e0841ba8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b8baba-bdbe-4aee-acb4-9f33b78a41c5', 'volume_name': 'volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe6ce3f-3482-4326-a1aa-e21cf1d0ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe6ce3f-3482-4326-a1aa-e21cf1d0ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa51341b-8be4-4737-96c6-c68a052469ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:30 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Volume 12b8baba-bdbe-4aee-acb4-9f33b78a41c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5', 'volume_size': 1} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1096852214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b8baba-bdbe-4aee-acb4-9f33b78a41c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4264fd7b8bb340d99af0356cc7ef7134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:31Z,use_quota=True,user_id='95f8a1ba431040de907c4ebd13f7a15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Creating volume 12b8baba-bdbe-4aee-acb4-9f33b78a41c5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:30 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:30 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 1073741824 Apr 13 14:15:30 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:31 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 1073741824" returned: 0 in 0.633s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=116,cinder:UPDATE=113,cinder:INSERT=24,cinder:DELETE=5 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=100,cinder:UPDATE=109,cinder:INSERT=40,cinder:DELETE=5 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:31 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 Apr 13 14:15:31 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:31 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa51341b-8be4-4737-96c6-c68a052469ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b51298-a008-4456-8666-4277ea23ad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:31 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Volume volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 (12b8baba-bdbe-4aee-acb4-9f33b78a41c5): created successfully Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b51298-a008-4456-8666-4277ea23ad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Flow 'volume_create_manager' (334e022f-bee4-40ff-832b-187de656de22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:31 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d30e4e9b-0a11-4c4c-a936-ba12061f7dab tempest-VolumesTransfersV357Test-1755516174 None] Created volume successfully. Apr 13 14:15:33 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-78dad29f-1081-4e49-9993-609d3ec74fd6 tempest-VolumesTransfersV357Test-992905037 None] Transfer volume completed successfully. Apr 13 14:15:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Acquiring lock "cinder-12b8baba-bdbe-4aee-acb4-9f33b78a41c5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-12b8baba-bdbe-4aee-acb4-9f33b78a41c5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Acquiring lock "cinder-quobyte-12b8baba-bdbe-4aee-acb4-9f33b78a41c5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-quobyte-12b8baba-bdbe-4aee-acb4-9f33b78a41c5" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:34 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a71cb-1533-46b0-a724-7373c7bec0ca]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:34 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 Apr 13 14:15:34 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:35 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5" returned: 0 in 0.885s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:35 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5 Apr 13 14:15:35 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:35 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12b8baba-bdbe-4aee-acb4-9f33b78a41c5" returned: 0 in 0.703s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:35 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-quobyte-12b8baba-bdbe-4aee-acb4-9f33b78a41c5" released by "delete_volume" :: held 1.638s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:35 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Created reservations ['bda135b9-31fe-498a-bcdc-3c563a594f2a', '56e88bc0-999f-44b1-bfa7-3d0a9a0b16c1', 'fc12e275-9ff1-4357-a2ed-725518959df5', 'e556387b-6f60-4e69-a4da-356c26441830'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:36 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:36 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:36 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.624s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:36 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Deleted volume successfully. Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89a6fc2f-1c37-4d3f-8ed2-48a0dd556fe5 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-12b8baba-bdbe-4aee-acb4-9f33b78a41c5-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Flow 'volume_create_manager' (78c6f4e3-1c0b-4a1c-971a-96f345c1d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e211b7-1887-41dc-aeab-a676babaacd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e211b7-1887-41dc-aeab-a676babaacd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1201548577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14039cb7-c9bf-471d-aabf-b96759a6ba0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4264fd7b8bb340d99af0356cc7ef7134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:37Z,use_quota=True,user_id='95f8a1ba431040de907c4ebd13f7a15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c12499-9c15-4103-b7c0-1140eebe3f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c12499-9c15-4103-b7c0-1140eebe3f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e72cab2-6a70-4f38-bbcc-6fbb8fd10868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e72cab2-6a70-4f38-bbcc-6fbb8fd10868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14039cb7-c9bf-471d-aabf-b96759a6ba0e', 'volume_name': 'volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31133cda-bc61-4e01-9ba5-352dcc25fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31133cda-bc61-4e01-9ba5-352dcc25fd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc34924-f270-41b0-ab3a-99b26f8f1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:36 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Volume 14039cb7-c9bf-471d-aabf-b96759a6ba0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e', 'volume_size': 1} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1201548577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14039cb7-c9bf-471d-aabf-b96759a6ba0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4264fd7b8bb340d99af0356cc7ef7134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:37Z,use_quota=True,user_id='95f8a1ba431040de907c4ebd13f7a15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Creating volume 14039cb7-c9bf-471d-aabf-b96759a6ba0e {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:36 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:36 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e 1073741824 Apr 13 14:15:36 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:36 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Flow 'volume_create_manager' (917df5be-8d3b-4880-b349-320cf823eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73d5fae-b371-41f0-959d-8fa41d4849b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73d5fae-b371-41f0-959d-8fa41d4849b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1415109317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baa13e7-007c-48c0-839b-a00e474cf4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254d0ec91bba4e8cb5b64e02fb56afc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:37Z,use_quota=True,user_id='39209724acec498e8e7d80b97e4c03e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c09980a-4d33-4b09-a1a9-a4ff656c92bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c09980a-4d33-4b09-a1a9-a4ff656c92bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11db50f-0ab3-48ef-8bc0-e9dec3420aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11db50f-0ab3-48ef-8bc0-e9dec3420aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8baa13e7-007c-48c0-839b-a00e474cf4ad', 'volume_name': 'volume-8baa13e7-007c-48c0-839b-a00e474cf4ad', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2188e9-f658-467e-ae54-cf97194c08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2188e9-f658-467e-ae54-cf97194c08af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707e8131-07f4-4573-a1f4-4b36dfe3bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:37 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Volume 8baa13e7-007c-48c0-839b-a00e474cf4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8baa13e7-007c-48c0-839b-a00e474cf4ad', 'volume_size': 1} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:37 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e 1073741824" returned: 0 in 0.549s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:37 devstack sudo[85792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e Apr 13 14:15:37 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:38 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e" returned: 0 in 0.517s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1415109317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baa13e7-007c-48c0-839b-a00e474cf4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254d0ec91bba4e8cb5b64e02fb56afc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:37Z,use_quota=True,user_id='39209724acec498e8e7d80b97e4c03e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Creating volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:38 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc34924-f270-41b0-ab3a-99b26f8f1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:38 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad 1073741824 Apr 13 14:15:38 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5eedee7-a219-4945-80fc-6ccc38f70d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:38 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Volume volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e (14039cb7-c9bf-471d-aabf-b96759a6ba0e): created successfully Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5eedee7-a219-4945-80fc-6ccc38f70d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Flow 'volume_create_manager' (78c6f4e3-1c0b-4a1c-971a-96f345c1d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:38 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-39c2b427-60de-46cd-853e-ae2d6704808a tempest-VolumesTransfersV357Test-1755516174 None] Created volume successfully. Apr 13 14:15:38 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad 1073741824" returned: 0 in 0.711s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:38 devstack sudo[85804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad Apr 13 14:15:38 devstack sudo[85804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Acquiring lock "cinder-14039cb7-c9bf-471d-aabf-b96759a6ba0e-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-14039cb7-c9bf-471d-aabf-b96759a6ba0e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Acquiring lock "cinder-quobyte-14039cb7-c9bf-471d-aabf-b96759a6ba0e" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-quobyte-14039cb7-c9bf-471d-aabf-b96759a6ba0e" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f639cf2-ca1e-4246-8a4f-5c3cb3b57358]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:39 devstack sudo[85804]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad" returned: 0 in 0.636s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707e8131-07f4-4573-a1f4-4b36dfe3bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8baa13e7-007c-48c0-839b-a00e474cf4ad', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6128e25c-2483-4aac-87ca-38d773cc07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Volume volume-8baa13e7-007c-48c0-839b-a00e474cf4ad (8baa13e7-007c-48c0-839b-a00e474cf4ad): created successfully Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6128e25c-2483-4aac-87ca-38d773cc07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Flow 'volume_create_manager' (917df5be-8d3b-4880-b349-320cf823eec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:39 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-364fe71f-0baa-44a6-a466-2f4db6a1fad1 tempest-SnapshotsActionsTest-699062400 None] Created volume successfully. Apr 13 14:15:39 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e Apr 13 14:15:39 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:39 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e" returned: 0 in 0.595s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:39 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e Apr 13 14:15:39 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Creating offline snapshot b2db6eef-4a68-4221-9a20-c41b5646e1ec of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[77697ba3-752d-410a-8437-8b325b1e57e8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:40 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad Apr 13 14:15:40 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:40 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14039cb7-c9bf-471d-aabf-b96759a6ba0e" returned: 0 in 0.558s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-quobyte-14039cb7-c9bf-471d-aabf-b96759a6ba0e" released by "delete_volume" :: held 1.182s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Created reservations ['cb4aca50-c262-4fab-99a4-6d373df55be6', 'b70fa535-003c-436d-8dc5-ff6a9bae3d8a', '64481fd4-2830-4c18-8ab6-3dad103a3284', '2e2c7e66-315e-46d5-ac30-0e7e85b7a255'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:40 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:40 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:41 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad" returned: 0 in 0.709s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:41 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec 1G Apr 13 14:15:41 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:41 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.492s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:41 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Deleted volume successfully. Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-310dfe02-bde2-4d1c-9a2d-e636faa6c4d9 tempest-VolumesTransfersV357Test-1371342588 None] Lock "cinder-14039cb7-c9bf-471d-aabf-b96759a6ba0e-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:41 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec 1G" returned: 0 in 0.604s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:41 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:41 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:42 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.643s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:42 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec is being set with open permissions: ugo+rw Apr 13 14:15:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:42 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:42 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:42 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.558s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:42 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info Apr 13 14:15:42 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:43 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:43 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info is being set with open permissions: ugo+rw Apr 13 14:15:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:43 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info Apr 13 14:15:43 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:43 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.info" returned: 0 in 0.514s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.584s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-52947db0-7278-46e0-8e93-5f5a98da01ef tempest-SnapshotsActionsTest-699062400 None] Create snapshot completed successfully Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Creating offline snapshot e2334ba3-6847-48ce-80f9-b7aa3c5db711 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca3fcc8-bac7-44b4-9956-adc336377593]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:45 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:45 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:45 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.703s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:45 devstack sudo[85899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 1G Apr 13 14:15:45 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:46 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 1G" returned: 0 in 0.718s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:46 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 Apr 13 14:15:46 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:47 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711" returned: 0 in 0.675s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:47 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 is being set with open permissions: ugo+rw Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:47 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 Apr 13 14:15:47 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:47 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711" returned: 0 in 0.520s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1468a56b-39e3-4554-9e12-6f20f9bace1f tempest-SnapshotsActionsTest-699062400 None] Create snapshot completed successfully Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Flow 'volume_create_manager' (d9ecd2ae-4680-4bc9-bbca-9c9dd24106eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733039b6-9dfd-4746-893b-ff986eaf36d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733039b6-9dfd-4746-893b-ff986eaf36d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-522298798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03299fa-0b40-4b37-a270-03c08ce9e02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bc9e6ca026477d8f8d28cf60e37ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:48Z,use_quota=True,user_id='acd1dd88887f41738d2fc9d3afe5034b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7107a0-49f2-48a6-896f-be7dcb01ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7107a0-49f2-48a6-896f-be7dcb01ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8bff3c-b850-46db-848f-e0e939ac8849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8bff3c-b850-46db-848f-e0e939ac8849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03299fa-0b40-4b37-a270-03c08ce9e02b', 'volume_name': 'volume-c03299fa-0b40-4b37-a270-03c08ce9e02b', 'volume_size': 2}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eab4f83-4253-4de5-b96f-9b9fb8c9b79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eab4f83-4253-4de5-b96f-9b9fb8c9b79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf1ca35-74a4-4cae-8df3-7a53eb5bb2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:47 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Volume c03299fa-0b40-4b37-a270-03c08ce9e02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03299fa-0b40-4b37-a270-03c08ce9e02b', 'volume_size': 2} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-522298798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03299fa-0b40-4b37-a270-03c08ce9e02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07bc9e6ca026477d8f8d28cf60e37ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:15:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:15:48Z,use_quota=True,user_id='acd1dd88887f41738d2fc9d3afe5034b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Creating volume c03299fa-0b40-4b37-a270-03c08ce9e02b {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:15:47 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:15:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b 2147483648 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:47 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b 2147483648 Apr 13 14:15:47 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-e2334ba3-6847-48ce-80f9-b7aa3c5db711-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-e2334ba3-6847-48ce-80f9-b7aa3c5db711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-e2334ba3-6847-48ce-80f9-b7aa3c5db711" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-e2334ba3-6847-48ce-80f9-b7aa3c5db711" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Deleting offline snapshot e2334ba3-6847-48ce-80f9-b7aa3c5db711 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] snapshot_file for this snap is: volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e2297b-6d9d-463a-89d4-9275075156e8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:48 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 Apr 13 14:15:48 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:48 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b 2147483648" returned: 0 in 0.638s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:48 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b Apr 13 14:15:48 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:48 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711" returned: 0 in 0.580s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25c40c-95d9-475c-a9c9-a64e1d9df456]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:48 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b" returned: 0 in 0.414s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf1ca35-74a4-4cae-8df3-7a53eb5bb2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03299fa-0b40-4b37-a270-03c08ce9e02b', 'volume_size': 2}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a943ff4b-6d81-4179-a83c-7ef60c5b93b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:15:48 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Volume volume-c03299fa-0b40-4b37-a270-03c08ce9e02b (c03299fa-0b40-4b37-a270-03c08ce9e02b): created successfully Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a943ff4b-6d81-4179-a83c-7ef60c5b93b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:15:48 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Flow 'volume_create_manager' (d9ecd2ae-4680-4bc9-bbca-9c9dd24106eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:15:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-730a5d0a-50c3-4f1b-b355-7c56a6fa9593 tempest-VolumesCloneNegativeTest-1658511144 None] Created volume successfully. Apr 13 14:15:49 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:49 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:49 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:49 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 Apr 13 14:15:49 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:49 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:50 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711 Apr 13 14:15:50 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Acquiring lock "cinder-c03299fa-0b40-4b37-a270-03c08ce9e02b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "cinder-c03299fa-0b40-4b37-a270-03c08ce9e02b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Acquiring lock "cinder-quobyte-c03299fa-0b40-4b37-a270-03c08ce9e02b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "cinder-quobyte-c03299fa-0b40-4b37-a270-03c08ce9e02b" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[624fa959-f18a-4378-937f-f90f495f88fa]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:50 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b Apr 13 14:15:50 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:50 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.e2334ba3-6847-48ce-80f9-b7aa3c5db711" returned: 0 in 0.482s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-e2334ba3-6847-48ce-80f9-b7aa3c5db711" released by "_delete_snapshot" :: held 2.198s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" released by "delete_snapshot" :: held 2.211s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Created reservations ['4495b129-cd9f-4a0b-9998-093d2b294b1d', 'a44ef31f-fece-4f09-b1a8-837d30bdac31', '4ff76eb2-d458-4a0f-9f33-b37f13f497ba', 'e2b95371-da7c-4c3c-a836-13517c3c6a00'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Delete snapshot completed successfully. Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a9ae76d9-848e-40c5-98ef-734071f9d2f1 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-e2334ba3-6847-48ce-80f9-b7aa3c5db711-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:50 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b" returned: 0 in 0.538s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:50 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b Apr 13 14:15:50 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:51 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c03299fa-0b40-4b37-a270-03c08ce9e02b" returned: 0 in 0.512s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "cinder-quobyte-c03299fa-0b40-4b37-a270-03c08ce9e02b" released by "delete_volume" :: held 1.091s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Created reservations ['cdb58970-c3e3-42c1-97d5-8b73865e4743', 'b9976f9d-4f84-49dc-9b75-07e535a45841', 'eccc3332-769c-4b97-9fff-eea5cb16b939', '7aa6d2e0-d3c6-4312-8203-0a988a07070c'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:51 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:15:51 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Creating offline snapshot bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0192a8-af63-4dd8-aa4b-5fe09a99f18c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:51 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.445s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:15:51 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:51 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:51 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Deleted volume successfully. Apr 13 14:15:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d2bb5ad-a13f-4502-8aa9-28a219fe5660 tempest-VolumesCloneNegativeTest-1658511144 None] Lock "cinder-c03299fa-0b40-4b37-a270-03c08ce9e02b-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:52 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.602s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:52 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 1G Apr 13 14:15:52 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:53 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 1G" returned: 0 in 0.833s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:53 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 Apr 13 14:15:53 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:53 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" returned: 0 in 0.789s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:53 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 is being set with open permissions: ugo+rw Apr 13 14:15:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:53 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 Apr 13 14:15:53 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:54 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" returned: 0 in 0.584s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:15:54 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1d353847-3540-4e92-b3b2-94ebc032cf8b tempest-SnapshotsActionsTest-699062400 None] Create snapshot completed successfully Apr 13 14:15:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-bb8bd739-69c1-47cd-ad64-5cdaa9443dd2-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-bb8bd739-69c1-47cd-ad64-5cdaa9443dd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Deleting offline snapshot bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] snapshot_file for this snap is: volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5177ebbb-b466-431e-87b1-9187dd1f9268]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:55 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 Apr 13 14:15:55 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:55 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" returned: 0 in 0.893s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec584f8e-baf3-4e9e-8a78-6bdbd48d9897]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:56 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:56 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:56 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.673s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:56 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 Apr 13 14:15:56 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:57 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" returned: 0 in 0.645s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:57 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2 Apr 13 14:15:57 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:57 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" returned: 0 in 0.503s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-bb8bd739-69c1-47cd-ad64-5cdaa9443dd2" released by "_delete_snapshot" :: held 2.779s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" released by "delete_snapshot" :: held 2.808s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Created reservations ['6a514826-e18f-4600-9084-7349a677f013', '3356ace1-9a1c-412f-9426-1dc2d39485b9', '5adab83c-a818-40df-beb9-1b43cf171c53', '75454480-0c8e-4490-9fb3-d88fb444723e'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:15:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Delete snapshot completed successfully. Apr 13 14:15:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f1d9fac5-67dc-420a-b0e4-7c37a7673bf6 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-bb8bd739-69c1-47cd-ad64-5cdaa9443dd2-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Creating offline snapshot c25523ff-8a50-40fe-b368-9acbfcad9139 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c262adf-7b2b-4289-bbdf-34b5c86a5e85]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:58 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:15:58 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:58 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.551s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:15:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:58 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 1G Apr 13 14:15:58 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:15:59 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 13 14:15:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 1G" returned: 0 in 0.748s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:15:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:15:59 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 Apr 13 14:15:59 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:00 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139" returned: 0 in 1.123s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:00 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 is being set with open permissions: ugo+rw Apr 13 14:16:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:00 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 Apr 13 14:16:00 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:01 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139" returned: 0 in 1.128s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.689s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5e40ee63-618c-457f-9f78-2d15cb1d7594 tempest-SnapshotsActionsTest-699062400 None] Create snapshot completed successfully Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-c25523ff-8a50-40fe-b368-9acbfcad9139-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-c25523ff-8a50-40fe-b368-9acbfcad9139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-c25523ff-8a50-40fe-b368-9acbfcad9139" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-c25523ff-8a50-40fe-b368-9acbfcad9139" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Deleting offline snapshot c25523ff-8a50-40fe-b368-9acbfcad9139 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] snapshot_file for this snap is: volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae63fe-6dd8-497b-9a5d-ae9ba354a9dd]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:03 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 Apr 13 14:16:03 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:04 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139" returned: 0 in 1.788s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fb35df-7080-497e-8a5e-96f10d0cd051]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:04 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:16:04 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:06 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 1.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:06 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 Apr 13 14:16:06 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (096f8622-69ea-4c11-9bd9-08492c88f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fbe8f3-4b75-4e8b-bd63-4f4438a2acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:07 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139" returned: 0 in 1.155s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fbe8f3-4b75-4e8b-bd63-4f4438a2acf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-851773054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff17a90-7db2-4295-a882-2b5119395ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:07Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd8e242-3681-4581-b97d-3a23380d52b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd8e242-3681-4581-b97d-3a23380d52b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8005cdf-27da-4804-b93b-2ebede9b93dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8005cdf-27da-4804-b93b-2ebede9b93dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff17a90-7db2-4295-a882-2b5119395ac0', 'volume_name': 'volume-eff17a90-7db2-4295-a882-2b5119395ac0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555f5867-2b8a-48b5-bd9c-2c147a9f4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555f5867-2b8a-48b5-bd9c-2c147a9f4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545f9857-4323-431e-8241-6331987d5146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:07 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Volume eff17a90-7db2-4295-a882-2b5119395ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff17a90-7db2-4295-a882-2b5119395ac0', 'volume_size': 1} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-851773054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff17a90-7db2-4295-a882-2b5119395ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:07Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Creating volume eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:07 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:07 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139 Apr 13 14:16:07 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:07 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 1073741824 Apr 13 14:16:07 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:08 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.c25523ff-8a50-40fe-b368-9acbfcad9139" returned: 0 in 0.598s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-c25523ff-8a50-40fe-b368-9acbfcad9139" released by "_delete_snapshot" :: held 5.174s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" released by "delete_snapshot" :: held 5.201s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Created reservations ['020b0eae-71c0-4bca-b664-3f2f269d307e', '19add78c-f66a-4838-a155-5e7ade8e39bf', 'f917decf-8d15-46e0-9bb5-636e8ca3e06c', '86107971-0c24-4285-af8e-bc9af3183e1b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:08 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Delete snapshot completed successfully. Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8aab45cc-4fe7-4911-b1a8-618bcde1c941 tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-c25523ff-8a50-40fe-b368-9acbfcad9139-delete_snapshot" released by "delete_snapshot" :: held 5.414s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:08 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 1073741824" returned: 0 in 0.957s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:08 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 Apr 13 14:16:08 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:08 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545f9857-4323-431e-8241-6331987d5146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff17a90-7db2-4295-a882-2b5119395ac0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e23466-2441-4c83-b4b3-11e3627bf566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Volume volume-eff17a90-7db2-4295-a882-2b5119395ac0 (eff17a90-7db2-4295-a882-2b5119395ac0): created successfully Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e23466-2441-4c83-b4b3-11e3627bf566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (096f8622-69ea-4c11-9bd9-08492c88f32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:08 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-61acf77a-95a5-4b9e-9bfb-5ae1b8ad1383 tempest-VolumesSnapshotTestJSON-485997044 None] Created volume successfully. Apr 13 14:16:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Creating offline snapshot 6bcf2355-1891-478c-b8e9-13da450122a8 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:16:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:09 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7407607-a4c0-4cd0-870b-a186bc09208a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:09 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:16:09 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:10 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:10 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 1G Apr 13 14:16:10 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:11 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 1G" returned: 0 in 0.645s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:11 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 Apr 13 14:16:11 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:11 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8" returned: 0 in 0.505s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:11 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 is being set with open permissions: ugo+rw Apr 13 14:16:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:11 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 Apr 13 14:16:11 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:12 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8" returned: 0 in 0.890s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.655s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Creating offline snapshot ca591a30-8314-4114-aaf6-055c1fa78a81 of volume eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:16:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-db1dd9b7-bc3c-4d1d-bf0e-753708e55124 tempest-SnapshotsActionsTest-699062400 None] Create snapshot completed successfully Apr 13 14:16:12 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e0acd8-7ac5-4a0b-ac49-2f1e7d1893a7]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:12 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 Apr 13 14:16:12 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-6bcf2355-1891-478c-b8e9-13da450122a8-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-6bcf2355-1891-478c-b8e9-13da450122a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Acquiring lock "cinder-quobyte-6bcf2355-1891-478c-b8e9-13da450122a8" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-6bcf2355-1891-478c-b8e9-13da450122a8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Deleting offline snapshot 6bcf2355-1891-478c-b8e9-13da450122a8 of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] snapshot_file for this snap is: volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdffa5b6-077e-429c-ace6-faf6e60ff7b6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:13 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 Apr 13 14:16:13 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:14 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0" returned: 0 in 1.575s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:14 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 1G Apr 13 14:16:14 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:14 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8" returned: 0 in 1.346s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:14 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fdee47-23c4-4450-b5b1-a595718d7f5f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:14 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:16:14 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:15 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 1G" returned: 0 in 1.194s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff17a90-7db2-4295-a882-2b5119395ac0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:15 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff17a90-7db2-4295-a882-2b5119395ac0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 Apr 13 14:16:15 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:15 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Flow 'volume_create_manager' (e658c724-0931-4f89-8957-7b1d4d7575e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:15 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0355258-8e87-485a-a939-c05810c8f5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 1.357s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0355258-8e87-485a-a939-c05810c8f5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf2a638-404d-4f7c-b727-597afab87912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b92e4c6738a43c7b366b1543ed3832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:16Z,use_quota=True,user_id='1addeb502dc8432d8a0084951ace2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43de2571-fbcb-4faa-92b9-3359a619846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43de2571-fbcb-4faa-92b9-3359a619846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342b13c2-4b51-4086-87f3-82574beeab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.image.glance [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Creating Keystone auth plugin from conf {{(pid=82621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 14:16:16 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 Apr 13 14:16:16 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:16 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff17a90-7db2-4295-a882-2b5119395ac0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81" returned: 0 in 1.129s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:16 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 is being set with open permissions: ugo+rw Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:16 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 Apr 13 14:16:16 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342b13c2-4b51-4086-87f3-82574beeab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cf2a638-404d-4f7c-b727-597afab87912', 'volume_name': 'volume-0cf2a638-404d-4f7c-b727-597afab87912', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a652e4-8c6a-4b50-a429-02a51fabc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a652e4-8c6a-4b50-a429-02a51fabc174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00064a7b-b273-4ea9-b677-0b778dc04ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:16 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Volume 0cf2a638-404d-4f7c-b727-597afab87912: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cf2a638-404d-4f7c-b727-597afab87912', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 14:16:16 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Trying to clone 0cf2a638-404d-4f7c-b727-597afab87912 from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]). {{(pid=82621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 14:16:17 devstack cinder-volume[82621]: INFO cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Image download 20.69 MB at 20.69 MB/s Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c2258-edf0-4d96-9661-a35836f887ba]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:17 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81" returned: 0 in 0.691s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:17 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD Apr 13 14:16:17 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:17 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info Apr 13 14:16:17 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:17 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8" returned: 0 in 1.565s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:17 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8 Apr 13 14:16:17 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:17 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD" returned: 0 in 0.646s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:17 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 is fetched for user 1addeb502dc8432d8a0084951ace2897. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e9987-876a-43cc-ac99-3dab0b58450d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:18 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info" returned: 0 in 0.921s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:18 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info is being set with open permissions: ugo+rw Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:18 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD Apr 13 14:16:18 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:18 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info Apr 13 14:16:18 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:18 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.6bcf2355-1891-478c-b8e9-13da450122a8" returned: 0 in 0.997s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-6bcf2355-1891-478c-b8e9-13da450122a8" released by "_delete_snapshot" :: held 5.336s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" released by "delete_snapshot" :: held 5.371s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Created reservations ['1731a92d-2aa5-4fb8-a77b-edf4b2af45ee', '303197f3-32e1-435e-8c3b-205ac6b2f7fb', 'ca2c2230-c17d-4664-9192-3e2aca63eedb', '1f662e40-0200-48c6-9f61-2500a1d9bbf3'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:18 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD" returned: 0 in 0.625s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:18 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Delete snapshot completed successfully. Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-cd01b148-50be-4bc4-ac1f-8b3a8f1db6dc tempest-SnapshotsActionsTest-1042733295 None] Lock "cinder-6bcf2355-1891-478c-b8e9-13da450122a8-delete_snapshot" released by "delete_snapshot" :: held 5.598s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:18 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.info" returned: 0 in 0.602s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.444s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf2a638-404d-4f7c-b727-597afab87912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b92e4c6738a43c7b366b1543ed3832a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:16Z,use_quota=True,user_id='1addeb502dc8432d8a0084951ace2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Creating volume 0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:18 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:18 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 1073741824 Apr 13 14:16:18 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-44d59ab8-de6e-4ad1-8c1f-a74ea2fb8672 tempest-VolumesSnapshotTestJSON-485997044 None] Create snapshot completed successfully Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:19 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:19 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-ca591a30-8314-4114-aaf6-055c1fa78a81-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-ca591a30-8314-4114-aaf6-055c1fa78a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-eff17a90-7db2-4295-a882-2b5119395ac0" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-eff17a90-7db2-4295-a882-2b5119395ac0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-ca591a30-8314-4114-aaf6-055c1fa78a81" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-ca591a30-8314-4114-aaf6-055c1fa78a81" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Deleting offline snapshot ca591a30-8314-4114-aaf6-055c1fa78a81 of volume eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] snapshot_file for this snap is: volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca0c73-1f2c-478b-afd8-7761bfff6348]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:20 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 1073741824" returned: 0 in 1.313s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:20 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 Apr 13 14:16:20 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:20 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.893s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:20 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:16:20 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "cinder-b2db6eef-4a68-4221-9a20-c41b5646e1ec-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-b2db6eef-4a68-4221-9a20-c41b5646e1ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "cinder-quobyte-b2db6eef-4a68-4221-9a20-c41b5646e1ec" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-quobyte-b2db6eef-4a68-4221-9a20-c41b5646e1ec" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Deleting offline snapshot b2db6eef-4a68-4221-9a20-c41b5646e1ec of volume 8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] snapshot_file for this snap is: volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f888b45-1271-404e-a492-fb97b4f9d1a3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:21 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81" returned: 0 in 1.002s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff17a90-7db2-4295-a882-2b5119395ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ac6165-64de-4808-aff3-9b2854737c3c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:21 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:16:21 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:21 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 Apr 13 14:16:21 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:21 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 0 in 1.120s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] <== create_volume: return (2800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.805s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:22 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 0.930s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa13e7-007c-48c0-839b-a00e474cf4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Attempting download of c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume 0cf2a638-404d-4f7c-b727-597afab87912. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc1e34-00e4-4126-9dff-9f1b2ff28514]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df27abe-e0fe-4c24-8340-61b410c0a38e]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:22 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad Apr 13 14:16:22 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:22 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0" returned: 0 in 1.209s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:22 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j Apr 13 14:16:22 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:22 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 Apr 13 14:16:22 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:23 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j" returned: 0 in 0.866s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:23 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j Apr 13 14:16:23 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:23 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad" returned: 0 in 1.248s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:23 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:16:23 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:24 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81" returned: 0 in 1.658s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:24 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81 Apr 13 14:16:24 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:24 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j" returned: 1 in 1.031s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_stjgtu1j' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[786efb80-bde0-4c54-9178-caec42f12aca]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:24 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD Apr 13 14:16:24 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:24 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0.ca591a30-8314-4114-aaf6-055c1fa78a81" returned: 0 in 0.686s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-ca591a30-8314-4114-aaf6-055c1fa78a81" released by "_delete_snapshot" :: held 4.729s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-eff17a90-7db2-4295-a882-2b5119395ac0" released by "delete_snapshot" :: held 4.751s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['4321315d-36b5-43ee-b19e-fc4ba8447be4', 'bf75066f-2643-44d6-a661-41818d3093c1', '56384dda-6687-449e-abae-3962086a19a6', '3e73f64a-9de8-4b52-a33b-7a8730d9a5da'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:25 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 1.582s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:25 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD" returned: 0 in 0.848s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] c223e7fa-335f-4690-8d1c-349d8cc0aad3 was qcow2, converting to raw {{(pid=82621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 14:16:25 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec Apr 13 14:16:25 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:25 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:16:25 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Delete snapshot completed successfully. Apr 13 14:16:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c68e3013-345e-440c-8766-af01aa3f2911 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-ca591a30-8314-4114-aaf6-055c1fa78a81-delete_snapshot" released by "delete_snapshot" :: held 5.148s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:26 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (d4ed39d1-b7ae-4e30-8571-b671d55930bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edd449f-7b1e-4f92-a110-46d57c6bd5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad.b2db6eef-4a68-4221-9a20-c41b5646e1ec" returned: 0 in 1.284s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-quobyte-b2db6eef-4a68-4221-9a20-c41b5646e1ec" released by "_delete_snapshot" :: held 5.337s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edd449f-7b1e-4f92-a110-46d57c6bd5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2132933866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45b6d98-9441-477b-9fae-1b1fbc5a6e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:26Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d829a6a8-857b-4acc-970e-d358d61007c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d829a6a8-857b-4acc-970e-d358d61007c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96676030-cd19-4aea-b410-628d55ec4522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96676030-cd19-4aea-b410-628d55ec4522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b45b6d98-9441-477b-9fae-1b1fbc5a6e16', 'volume_name': 'volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04b95a0-e444-4cdd-b0f3-14bb20f35017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04b95a0-e444-4cdd-b0f3-14bb20f35017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f940c4-03bd-42ce-a150-11e8446c7265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:26 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Volume b45b6d98-9441-477b-9fae-1b1fbc5a6e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16', 'volume_size': 1} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2132933866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45b6d98-9441-477b-9fae-1b1fbc5a6e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:26Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Creating volume b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:26 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" released by "delete_snapshot" :: held 5.461s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:26 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 1073741824 Apr 13 14:16:26 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Created reservations ['415a8ba3-ca18-463a-a631-cfb87cfb73e9', '8304d476-ff36-4404-acff-ba279f288325', '604e5ae6-6290-4913-bf69-94f85603c199', '58de93b2-2119-48ab-bc59-c80c563c10c2'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:26 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Delete snapshot completed successfully. Apr 13 14:16:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd64c953-8c48-4755-916c-8cb61dbef48e tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-b2db6eef-4a68-4221-9a20-c41b5646e1ec-delete_snapshot" released by "delete_snapshot" :: held 5.819s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:27 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 0 in 1.907s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ivnmrsm0devstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:16:27 devstack cinder-volume[82621]: INFO cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Converted 112.00 MB image at 58.71 MB/s Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:27 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 1G Apr 13 14:16:27 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:27 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 1073741824" returned: 0 in 0.921s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:27 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:27 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "cinder-8baa13e7-007c-48c0-839b-a00e474cf4ad-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-8baa13e7-007c-48c0-839b-a00e474cf4ad-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6976e-7453-46f4-a57d-be4b3510b314]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:27 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad Apr 13 14:16:27 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:27 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 1G" returned: 0 in 0.743s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45dafe1-e935-4601-8c9e-6450f60f2d90]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:27 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:16:27 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:28 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.890s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f940c4-03bd-42ce-a150-11e8446c7265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f219e3-720b-499e-8717-0112722c86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:28 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Volume volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 (b45b6d98-9441-477b-9fae-1b1fbc5a6e16): created successfully Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f219e3-720b-499e-8717-0112722c86ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (d4ed39d1-b7ae-4e30-8571-b671d55930bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bd49b34c-7d8e-4e8e-b605-7068cf5f4eeb tempest-VolumesSnapshotTestJSON-485997044 None] Created volume successfully. Apr 13 14:16:28 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad" returned: 0 in 0.923s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:28 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad Apr 13 14:16:28 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:28 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 0 in 1.028s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:28 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:16:28 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:29 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8baa13e7-007c-48c0-839b-a00e474cf4ad" returned: 0 in 0.493s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-quobyte-8baa13e7-007c-48c0-839b-a00e474cf4ad" released by "delete_volume" :: held 1.446s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Created reservations ['47eca42a-72ba-43cc-9d52-4ac1bec9625f', '008094ca-5c51-4644-bf1f-b3bf35961f69', '0515ca46-90be-4413-b66b-f11328d7b14d', '61754d45-df8a-4f6e-99ef-b56bf96def01'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:29 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:29 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:29 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 1 in 0.524s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Downloaded image c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume 0cf2a638-404d-4f7c-b727-597afab87912 successfully. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 for user 1addeb502dc8432d8a0084951ace2897 is deleted. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Marking volume 0cf2a638-404d-4f7c-b727-597afab87912 as bootable. {{(pid=82621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Copying metadata from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 to 0cf2a638-404d-4f7c-b727-597afab87912. {{(pid=82621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Creating volume glance metadata for volume 0cf2a638-404d-4f7c-b727-597afab87912 backed by image c223e7fa-335f-4690-8d1c-349d8cc0aad3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00064a7b-b273-4ea9-b677-0b778dc04ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf2a638-404d-4f7c-b727-597afab87912', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0925227-2785-43f3-8cad-c2dbac26e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:29 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Volume volume-0cf2a638-404d-4f7c-b727-597afab87912 (0cf2a638-404d-4f7c-b727-597afab87912): created successfully Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0925227-2785-43f3-8cad-c2dbac26e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Flow 'volume_create_manager' (e658c724-0931-4f89-8957-7b1d4d7575e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-7312f190-3579-47da-b90e-bf3d9ab5ea04 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Created volume successfully. Apr 13 14:16:29 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.572s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Deleted volume successfully. Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5506cb1e-6cf8-4c58-98ad-0e8522407962 tempest-SnapshotsActionsTest-699062400 None] Lock "cinder-8baa13e7-007c-48c0-839b-a00e474cf4ad-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Creating offline snapshot d61c4424-b04e-4c79-8d84-5380e8f981d1 of volume b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9809f6-2fb5-48fd-8e1d-f869675a970a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:30 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:30 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:30 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.635s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:30 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 1G Apr 13 14:16:30 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:31 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 1G" returned: 0 in 1.036s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:31 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 Apr 13 14:16:31 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=104,cinder:SELECT=93,cinder:INSERT=40,cinder:DELETE=9 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=95,cinder:INSERT=22,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Flow 'volume_create_manager' (ad926bee-2b01-483b-b247-111dc15bfa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffda8b4-5f77-4d04-a052-2d950aaf5997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffda8b4-5f77-4d04-a052-2d950aaf5997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-722186960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e66452-7aff-4069-984f-6beb55a3916b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d32ae9e98494384ae5679c97e48c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:32Z,use_quota=True,user_id='2d11b776655e4f838cc3d9796bd42c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a245770-fb7b-4dba-824e-24c501ff06db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a245770-fb7b-4dba-824e-24c501ff06db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde70059-a9ac-4602-9ab8-59cfe2173f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde70059-a9ac-4602-9ab8-59cfe2173f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12e66452-7aff-4069-984f-6beb55a3916b', 'volume_name': 'volume-12e66452-7aff-4069-984f-6beb55a3916b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f04b04e-659a-4f17-ac88-414950fa960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f04b04e-659a-4f17-ac88-414950fa960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43ff94-3959-4c26-8846-eaf0768e57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:31 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Volume 12e66452-7aff-4069-984f-6beb55a3916b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12e66452-7aff-4069-984f-6beb55a3916b', 'volume_size': 1} Apr 13 14:16:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:32 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1" returned: 0 in 0.751s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:32 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 is being set with open permissions: ugo+rw Apr 13 14:16:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:32 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 Apr 13 14:16:32 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:32 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1" returned: 0 in 0.556s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:32 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info Apr 13 14:16:32 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:33 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info" returned: 0 in 0.452s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:33 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info is being set with open permissions: ugo+rw Apr 13 14:16:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:33 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info Apr 13 14:16:33 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:33 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.info" returned: 0 in 0.554s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.073s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-722186960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12e66452-7aff-4069-984f-6beb55a3916b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d32ae9e98494384ae5679c97e48c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:32Z,use_quota=True,user_id='2d11b776655e4f838cc3d9796bd42c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Creating volume 12e66452-7aff-4069-984f-6beb55a3916b {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:34 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:34 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b 1073741824 Apr 13 14:16:34 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:34 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ce5c4aed-b3d8-4a35-8ffb-3131f9c136b6 tempest-VolumesSnapshotTestJSON-485997044 None] Create snapshot completed successfully Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (217e52e7-bda0-4ede-9fa9-3413a514726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ebca27-d00d-4f6b-966b-adfb89b3b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ebca27-d00d-4f6b-966b-adfb89b3b21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1990549372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc47659-16cb-4059-b84e-33c3b965347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d61c4424-b04e-4c79-8d84-5380e8f981d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:34Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46924f4c-791d-4616-bc3e-00a5d8ad4de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46924f4c-791d-4616-bc3e-00a5d8ad4de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d95901-54d8-4deb-a49b-5e1a78b801a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d95901-54d8-4deb-a49b-5e1a78b801a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcc47659-16cb-4059-b84e-33c3b965347b', 'volume_name': 'volume-bcc47659-16cb-4059-b84e-33c3b965347b', 'volume_size': 2, 'snapshot_id': 'd61c4424-b04e-4c79-8d84-5380e8f981d1'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4beb50c4-e9ab-4869-aed6-b0c8297e57b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4beb50c4-e9ab-4869-aed6-b0c8297e57b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9433724-85b6-4114-a67a-d92bb2c3d945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:34 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Volume bcc47659-16cb-4059-b84e-33c3b965347b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcc47659-16cb-4059-b84e-33c3b965347b', 'volume_size': 2, 'snapshot_id': 'd61c4424-b04e-4c79-8d84-5380e8f981d1'} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:34 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b 1073741824" returned: 0 in 0.574s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:34 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b Apr 13 14:16:34 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:35 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b" returned: 0 in 0.468s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.909s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43ff94-3959-4c26-8846-eaf0768e57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e66452-7aff-4069-984f-6beb55a3916b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5426c459-7459-494d-b6af-495c1e7f8515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:35 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Volume volume-12e66452-7aff-4069-984f-6beb55a3916b (12e66452-7aff-4069-984f-6beb55a3916b): created successfully Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5426c459-7459-494d-b6af-495c1e7f8515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Flow 'volume_create_manager' (ad926bee-2b01-483b-b247-111dc15bfa3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c582d-f2cc-4b73-93a2-c05bc5cb350e]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:35 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ed0be544-d99c-42a6-a95b-8c38f2aea277 tempest-ServersNegativeTestJSON-697243005 None] Created volume successfully. Apr 13 14:16:35 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:16:35 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Flow 'volume_create_manager' (5fcc2bdd-e8f4-4bd9-adc7-dfbaccc77f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7103a4cf-22ff-4cdd-afc7-f5df4aca4fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7103a4cf-22ff-4cdd-afc7-f5df4aca4fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-144895710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c28b38-0e74-4705-9ce9-194a91711ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bca232841741c1b1c9b95fc7668e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:35Z,use_quota=True,user_id='d259b3d770b5454eacabc8cb641bbe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea451e5-89d5-4fce-9e94-4fc3232100b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea451e5-89d5-4fce-9e94-4fc3232100b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9e1a85-20ed-46e6-8485-301bcf4b756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9e1a85-20ed-46e6-8485-301bcf4b756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c28b38-0e74-4705-9ce9-194a91711ee5', 'volume_name': 'volume-b2c28b38-0e74-4705-9ce9-194a91711ee5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c133ae-9d2c-4f75-99e6-b3ae03e045bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c133ae-9d2c-4f75-99e6-b3ae03e045bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3993206e-f8f6-43fb-8e89-6ed2bce525f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:35 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Volume b2c28b38-0e74-4705-9ce9-194a91711ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c28b38-0e74-4705-9ce9-194a91711ee5', 'volume_size': 1} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:35 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 0 in 0.657s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:35 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:16:35 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Flow 'volume_create_manager' (d8eabef5-0cbd-405d-b762-ed2c3a876815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e12f97c-fcec-4ca8-a5b0-ca6cd4c6ed67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e12f97c-fcec-4ca8-a5b0-ca6cd4c6ed67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-447966233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b219b40f-dd88-4cd2-be02-6c8908340567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d32ae9e98494384ae5679c97e48c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:36Z,use_quota=True,user_id='2d11b776655e4f838cc3d9796bd42c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd92f395-35b0-4fd3-a83d-172c73fb4725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd92f395-35b0-4fd3-a83d-172c73fb4725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c2f47c-151a-42e0-94d3-796237e796f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c2f47c-151a-42e0-94d3-796237e796f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b219b40f-dd88-4cd2-be02-6c8908340567', 'volume_name': 'volume-b219b40f-dd88-4cd2-be02-6c8908340567', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cb48ab-0247-4bf2-be2b-05df0f2eac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cb48ab-0247-4bf2-be2b-05df0f2eac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ddb7c7-35f3-4b3e-b568-f284f0d71c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:36 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Volume b219b40f-dd88-4cd2-be02-6c8908340567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b219b40f-dd88-4cd2-be02-6c8908340567', 'volume_size': 1} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:36 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 1 in 0.581s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.282s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.802s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-d61c4424-b04e-4c79-8d84-5380e8f981d1-bcc47659-16cb-4059-b84e-33c3b965347b" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-d61c4424-b04e-4c79-8d84-5380e8f981d1-bcc47659-16cb-4059-b84e-33c3b965347b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Creating volume bcc47659-16cb-4059-b84e-33c3b965347b from snapshot d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-bcc47659-16cb-4059-b84e-33c3b965347b" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1', 'name': 'volume-0cf2a638-404d-4f7c-b727-597afab87912', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6332608e-b4fc-4e03-a6e4-cabc73fe5dcd', 'enforce_multipath': True} {{(pid=82621) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-bcc47659-16cb-4059-b84e-33c3b965347b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] snapshot: d61c4424-b04e-4c79-8d84-5380e8f981d1, volume: bcc47659-16cb-4059-b84e-33c3b965347b, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:16:36 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-0b394fd8-c4ff-446c-aed0-b41c81b27615 req-cd2edd96-eca7-403a-8d05-565bba0860b3 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] attachment_update completed successfully. Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad2fbe6-d6ef-41d4-b0e9-21a43f05c7da]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:36 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 Apr 13 14:16:36 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:37 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1" returned: 0 in 0.552s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99e0f56-9299-455f-a293-21100cf997e7]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:37 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:37 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:37 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:16:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:37 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b Apr 13 14:16:37 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:40 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b" returned: 0 in 2.719s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:40 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6150e-d409-469e-8076-f27e5f6f96bd]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:40 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:40 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:40 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.599s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:40 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:16:40 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Converted 1024.00 MB image at 376.43 MB/s Apr 13 14:16:40 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b is being set with open permissions: ugo+rw Apr 13 14:16:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:40 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b Apr 13 14:16:40 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:41 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b" returned: 0 in 0.631s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-bcc47659-16cb-4059-b84e-33c3b965347b" released by "_copy_volume_from_snapshot" :: held 5.087s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-d61c4424-b04e-4c79-8d84-5380e8f981d1-bcc47659-16cb-4059-b84e-33c3b965347b" released by "_create_volume_from_snapshot" :: held 5.127s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.149s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.183s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-144895710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c28b38-0e74-4705-9ce9-194a91711ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bca232841741c1b1c9b95fc7668e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:35Z,use_quota=True,user_id='d259b3d770b5454eacabc8cb641bbe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Creating volume b2c28b38-0e74-4705-9ce9-194a91711ee5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:41 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:41 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 1073741824 Apr 13 14:16:41 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9433724-85b6-4114-a67a-d92bb2c3d945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc47659-16cb-4059-b84e-33c3b965347b', 'volume_size': 2, 'snapshot_id': 'd61c4424-b04e-4c79-8d84-5380e8f981d1'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fadfbb8-8d84-406f-8646-aa6916e27864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:41 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Volume volume-bcc47659-16cb-4059-b84e-33c3b965347b (bcc47659-16cb-4059-b84e-33c3b965347b): created successfully Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fadfbb8-8d84-406f-8646-aa6916e27864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (217e52e7-bda0-4ede-9fa9-3413a514726d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:41 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fc54bc63-37a0-4d85-ba24-c6daece37473 tempest-VolumesSnapshotTestJSON-485997044 None] Created volume successfully. Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-bcc47659-16cb-4059-b84e-33c3b965347b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-bcc47659-16cb-4059-b84e-33c3b965347b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-bcc47659-16cb-4059-b84e-33c3b965347b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-bcc47659-16cb-4059-b84e-33c3b965347b" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eb051b-09ec-416d-9975-7afd7db8af06]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:42 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b Apr 13 14:16:42 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:42 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 1073741824" returned: 0 in 0.783s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:42 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 Apr 13 14:16:42 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:42 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:42 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5" returned: 0 in 0.552s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.737s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-447966233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b219b40f-dd88-4cd2-be02-6c8908340567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d32ae9e98494384ae5679c97e48c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:36Z,use_quota=True,user_id='2d11b776655e4f838cc3d9796bd42c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Creating volume b219b40f-dd88-4cd2-be02-6c8908340567 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:42 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b" returned: 0 in 0.731s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:42 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 1073741824 Apr 13 14:16:42 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:42 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3993206e-f8f6-43fb-8e89-6ed2bce525f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c28b38-0e74-4705-9ce9-194a91711ee5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:42 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21cd482-7908-45eb-b3cd-0f602be656ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Volume volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 (b2c28b38-0e74-4705-9ce9-194a91711ee5): created successfully Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21cd482-7908-45eb-b3cd-0f602be656ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Flow 'volume_create_manager' (5fcc2bdd-e8f4-4bd9-adc7-dfbaccc77f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-21ca6709-4c5c-46e8-a5e5-1c7b7019cdef tempest-VolumeQuotasAdminTestJSON-679103200 None] Created volume successfully. Apr 13 14:16:43 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bcc47659-16cb-4059-b84e-33c3b965347b" returned: 0 in 0.532s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-bcc47659-16cb-4059-b84e-33c3b965347b" released by "delete_volume" :: held 1.304s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['8f34f4f2-f4ba-46c9-887c-739c93dfb499', '30bb86c0-dcea-4f5d-a4d2-ddd1dad30f9f', 'a73b8ba9-b963-40f6-8041-9af48109be4a', 'f0ef8df7-0c92-4c2a-bbe8-9d4829aaba1f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:43 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:43 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:43 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 1073741824" returned: 0 in 0.789s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:43 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 Apr 13 14:16:43 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "cinder-b2c28b38-0e74-4705-9ce9-194a91711ee5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "cinder-b2c28b38-0e74-4705-9ce9-194a91711ee5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "cinder-quobyte-b2c28b38-0e74-4705-9ce9-194a91711ee5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "cinder-quobyte-b2c28b38-0e74-4705-9ce9-194a91711ee5" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44840b-2104-4fb0-bfce-a2ea83ca5c8c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:44 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 Apr 13 14:16:44 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-d61c4424-b04e-4c79-8d84-5380e8f981d1-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-d61c4424-b04e-4c79-8d84-5380e8f981d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-d61c4424-b04e-4c79-8d84-5380e8f981d1" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-d61c4424-b04e-4c79-8d84-5380e8f981d1" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Deleting offline snapshot d61c4424-b04e-4c79-8d84-5380e8f981d1 of volume b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] snapshot_file for this snap is: volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e3bdc-d693-47ca-b643-63de6aa33c58]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:44 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 Apr 13 14:16:44 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:44 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:44 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 1.047s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567" returned: 0 in 0.933s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ddb7c7-35f3-4b3e-b568-f284f0d71c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b219b40f-dd88-4cd2-be02-6c8908340567', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24888473-5f15-470d-a9a9-e880adc24062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Deleted volume successfully. Apr 13 14:16:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Volume volume-b219b40f-dd88-4cd2-be02-6c8908340567 (b219b40f-dd88-4cd2-be02-6c8908340567): created successfully Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24888473-5f15-470d-a9a9-e880adc24062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Flow 'volume_create_manager' (d8eabef5-0cbd-405d-b762-ed2c3a876815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5588caac-4025-4d3a-a0a4-3fb41fdcfe37 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-bcc47659-16cb-4059-b84e-33c3b965347b-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c31a2061-fb46-4b1c-bc7b-039747024d6b tempest-ServersNegativeTestJSON-697243005 None] Created volume successfully. Apr 13 14:16:45 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5" returned: 0 in 0.934s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:45 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5 Apr 13 14:16:45 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:45 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1" returned: 0 in 0.620s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd51bc1-23ee-4d38-93d6-18bf925f26c4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:45 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:45 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:45 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b2c28b38-0e74-4705-9ce9-194a91711ee5" returned: 0 in 0.496s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "cinder-quobyte-b2c28b38-0e74-4705-9ce9-194a91711ee5" released by "delete_volume" :: held 1.462s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:45 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.618s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:45 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 Apr 13 14:16:45 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:46 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:46 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1 Apr 13 14:16:46 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:46 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Created reservations ['1f310383-739d-438d-b03c-26ba62d416b3', 'b96a480a-2a20-4c74-866f-d06a5ae9dcbc', '5f2ad70b-f6c9-401c-906f-d2484a39e1ea', '1d48d610-1432-4685-a9ed-f22359eb1f1d'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:46 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16.d61c4424-b04e-4c79-8d84-5380e8f981d1" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-d61c4424-b04e-4c79-8d84-5380e8f981d1" released by "_delete_snapshot" :: held 2.313s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" released by "delete_snapshot" :: held 2.330s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['ee9badf1-febe-4bf6-8b8f-67e4d811c1d1', '225771c3-74c2-4653-8112-bfeae71e0bef', 'a5807fdd-7128-4b10-b151-abc58a73d26b', 'b35e32bc-07da-436d-a3bd-da951d12df32'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "cinder-b219b40f-dd88-4cd2-be02-6c8908340567-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-b219b40f-dd88-4cd2-be02-6c8908340567-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "cinder-quobyte-b219b40f-dd88-4cd2-be02-6c8908340567" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:51 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:51 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-quobyte-b219b40f-dd88-4cd2-be02-6c8908340567" acquired by "delete_volume" :: waited 0.021s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e146550-189e-44e4-bf73-0c198dec591f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:51 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Delete snapshot completed successfully. Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5c4d0ee1-7f39-4003-9f7f-bebdf3b7ca2f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-d61c4424-b04e-4c79-8d84-5380e8f981d1-delete_snapshot" released by "delete_snapshot" :: held 7.523s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:52 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 Apr 13 14:16:52 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Flow 'volume_create_manager' (302ca105-0a04-4d1f-a0f8-66f048346828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107742b0-ca68-46f7-bdd2-3a178b2b2d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107742b0-ca68-46f7-bdd2-3a178b2b2d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-119458038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d033c395-6926-4e09-a8be-1f4907f9f64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bca232841741c1b1c9b95fc7668e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:52Z,use_quota=True,user_id='d259b3d770b5454eacabc8cb641bbe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3a88b1-a61b-4f65-93ce-5f84bd1a28d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3a88b1-a61b-4f65-93ce-5f84bd1a28d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8ffdcf-186a-431a-b4d6-71ef3eafa8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8ffdcf-186a-431a-b4d6-71ef3eafa8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd033c395-6926-4e09-a8be-1f4907f9f64c', 'volume_name': 'volume-d033c395-6926-4e09-a8be-1f4907f9f64c', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0ccbfb-0fdb-4c3b-923c-87669a9b1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0ccbfb-0fdb-4c3b-923c-87669a9b1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208be1de-0c42-4e8b-a9ca-f8f4a4a3369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:52 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Volume d033c395-6926-4e09-a8be-1f4907f9f64c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d033c395-6926-4e09-a8be-1f4907f9f64c', 'volume_size': 1} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-119458038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d033c395-6926-4e09-a8be-1f4907f9f64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bca232841741c1b1c9b95fc7668e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:52Z,use_quota=True,user_id='d259b3d770b5454eacabc8cb641bbe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Creating volume d033c395-6926-4e09-a8be-1f4907f9f64c {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:52 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:52 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c 1073741824 Apr 13 14:16:52 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:52 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.596s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Deleted volume successfully. Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6152a177-0d13-438e-ae6b-8e70adfc0654 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "cinder-b2c28b38-0e74-4705-9ce9-194a91711ee5-delete_volume" released by "delete_volume" :: held 8.355s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:52 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567" returned: 0 in 0.670s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:52 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567 Apr 13 14:16:52 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:52 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c 1073741824" returned: 0 in 0.524s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:52 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c Apr 13 14:16:52 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-b45b6d98-9441-477b-9fae-1b1fbc5a6e16-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-b45b6d98-9441-477b-9fae-1b1fbc5a6e16-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" acquired by "delete_volume" :: waited 0.018s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6435aa0-5d3b-4a40-8dde-bc7805906e7c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:53 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b219b40f-dd88-4cd2-be02-6c8908340567" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-quobyte-b219b40f-dd88-4cd2-be02-6c8908340567" released by "delete_volume" :: held 1.162s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:53 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:53 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Created reservations ['44820771-a501-4cc4-b3af-cd0bd219d845', '719a8b51-723a-4a6f-8b6d-04b5a671b08e', 'eb476e23-908c-411a-b84b-7b284a469f16', 'b599de28-5ce8-4273-b080-901344c59ef5'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:53 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:53 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:53 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208be1de-0c42-4e8b-a9ca-f8f4a4a3369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d033c395-6926-4e09-a8be-1f4907f9f64c', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4ab2e8-e5e2-49d9-b1be-77c774bc5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:53 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Volume volume-d033c395-6926-4e09-a8be-1f4907f9f64c (d033c395-6926-4e09-a8be-1f4907f9f64c): created successfully Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4ab2e8-e5e2-49d9-b1be-77c774bc5042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Flow 'volume_create_manager' (302ca105-0a04-4d1f-a0f8-66f048346828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8ffd85e1-a00b-4376-8d56-88984a6668b9 tempest-VolumeQuotasAdminTestJSON-679103200 None] Created volume successfully. Apr 13 14:16:53 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.530s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:53 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16 Apr 13 14:16:53 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:53 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.438s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Deleted volume successfully. Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2465ed78-bcfe-4a2a-9fde-aee11c5148a3 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-b219b40f-dd88-4cd2-be02-6c8908340567-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "cinder-12e66452-7aff-4069-984f-6beb55a3916b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-12e66452-7aff-4069-984f-6beb55a3916b-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:53 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" returned: 0 in 0.464s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-b45b6d98-9441-477b-9fae-1b1fbc5a6e16" released by "delete_volume" :: held 1.035s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "cinder-quobyte-12e66452-7aff-4069-984f-6beb55a3916b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-quobyte-12e66452-7aff-4069-984f-6beb55a3916b" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a0b3f-f312-4b87-87ef-2ab1489d6252]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['28be9fa6-0ef2-410c-b700-fbfd78ee31b8', '5d4a5fd0-55f3-417e-96ca-c02994f18ba8', 'ef5c5a94-bf64-4c21-b08c-a6f9c1432ad3', 'c44755fc-8628-4a0e-bfd4-c09c6490faf9'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:54 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b Apr 13 14:16:54 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:54 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:54 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:54 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7f81b044-aeb2-426f-9994-1ee1f965ffaf tempest-VolumeQuotasAdminTestJSON-694810276 None] Transfer volume completed successfully. Apr 13 14:16:54 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:54 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:54 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Deleted volume successfully. Apr 13 14:16:54 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b Apr 13 14:16:54 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b84ef90a-11c2-4960-b508-a6b5ba447485 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-b45b6d98-9441-477b-9fae-1b1fbc5a6e16-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:55 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-12e66452-7aff-4069-984f-6beb55a3916b" returned: 0 in 0.417s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-quobyte-12e66452-7aff-4069-984f-6beb55a3916b" released by "delete_volume" :: held 0.979s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Created reservations ['ea00f758-0b4f-454d-8f4c-05d621ffa287', '1c7faf3b-f73f-4d01-9df4-90a48b647bbd', 'cd233d6c-0d82-4414-9f65-7edd12083713', '8fe2c9de-e784-4f8b-b35f-b6a523859266'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:55 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:55 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Acquiring lock "cinder-d033c395-6926-4e09-a8be-1f4907f9f64c-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Lock "cinder-d033c395-6926-4e09-a8be-1f4907f9f64c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Acquiring lock "cinder-quobyte-d033c395-6926-4e09-a8be-1f4907f9f64c" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Lock "cinder-quobyte-d033c395-6926-4e09-a8be-1f4907f9f64c" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e082f90-4374-405c-b8db-a5c28ffbf5e9]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (c2740e39-a859-405e-b145-6779b6292e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09dc32bb-2bbf-493f-a243-dea87ad39f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09dc32bb-2bbf-493f-a243-dea87ad39f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545301135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:56Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d086ac9-01cf-4160-aa74-161733d28365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d086ac9-01cf-4160-aa74-161733d28365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bd9339-be31-4115-bcd8-2e6dd0b6449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bd9339-be31-4115-bcd8-2e6dd0b6449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2', 'volume_name': 'volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:55 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c Apr 13 14:16:55 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c14058-337f-4bfe-a7b4-60aaa2f9afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c14058-337f-4bfe-a7b4-60aaa2f9afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4b32d4-01ec-45df-81ce-4155823e0f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:55 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Volume ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2', 'volume_size': 1} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545301135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:16:56Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Creating volume ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:16:55 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:55 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 1073741824 Apr 13 14:16:55 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:55 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.603s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Deleted volume successfully. Apr 13 14:16:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-971c3990-dd28-42ef-a983-7aa21047d539 tempest-ServersNegativeTestJSON-697243005 None] Lock "cinder-12e66452-7aff-4069-984f-6beb55a3916b-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:56 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c" returned: 0 in 0.528s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:56 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c Apr 13 14:16:56 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:56 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 1073741824" returned: 0 in 0.520s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:56 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:16:56 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:56 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d033c395-6926-4e09-a8be-1f4907f9f64c" returned: 0 in 0.519s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Lock "cinder-quobyte-d033c395-6926-4e09-a8be-1f4907f9f64c" released by "delete_volume" :: held 1.076s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Created reservations ['956f16a5-13ef-4f28-a176-7f8099d20746', '902bb3d2-4172-47eb-9a47-66b35f74df3d', 'e924b7a1-15a5-4a6c-b547-eb76036c16ce', '7e771ec2-39c4-4185-93b7-117515a0f278'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:56 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:16:56 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:56 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.669s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4b32d4-01ec-45df-81ce-4155823e0f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a964574a-77f2-40ef-8dbf-225856829ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:16:56 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Volume volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 (ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2): created successfully Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a964574a-77f2-40ef-8dbf-225856829ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:16:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (c2740e39-a859-405e-b145-6779b6292e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:16:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2e1fbc2f-2804-4a68-bfb9-cc46cf0ac737 tempest-VolumesSnapshotTestJSON-485997044 None] Created volume successfully. Apr 13 14:16:57 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.553s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:57 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:16:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Deleted volume successfully. Apr 13 14:16:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7d0361fb-0df2-416e-b0f7-0aa69cbde1b8 tempest-VolumeQuotasAdminTestJSON-190539385 None] Lock "cinder-d033c395-6926-4e09-a8be-1f4907f9f64c-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Creating offline snapshot 5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 of volume ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a9698-d563-4f29-a35c-0e5c1ed774c0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:58 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:16:58 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:58 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.859s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:58 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 1G Apr 13 14:16:58 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:16:59 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 13 14:16:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 1G" returned: 0 in 0.751s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:16:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:16:59 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 Apr 13 14:16:59 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:00 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" returned: 0 in 0.570s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:00 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 is being set with open permissions: ugo+rw Apr 13 14:17:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:00 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 Apr 13 14:17:00 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:00 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" returned: 0 in 0.499s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:00 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info Apr 13 14:17:00 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:01 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info" returned: 0 in 0.585s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:01 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info is being set with open permissions: ugo+rw Apr 13 14:17:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:01 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info Apr 13 14:17:01 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:02 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.info" returned: 0 in 0.857s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-379d0207-3607-4185-9ddf-7a0e0aa989b7 tempest-VolumesSnapshotTestJSON-485997044 None] Create snapshot completed successfully Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (5b625de6-7fed-4b5c-befd-c7e5091a33c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e1c2eb-1457-4cc2-bfb5-9856a23edada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e1c2eb-1457-4cc2-bfb5-9856a23edada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1866482495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e0d10a-6d99-46d7-b9a9-a647141cc346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59cadad7e874b39a37e6a79ae33dea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ee0a62e-6116-46d3-8c79-4d9a2ac6b492,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:04Z,use_quota=True,user_id='064f09c281154bdc9d024ad0e84b0d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6e317b-542d-41f5-b1f4-60283273183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6e317b-542d-41f5-b1f4-60283273183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d6817e-5660-4b8d-a1aa-524eac10c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d6817e-5660-4b8d-a1aa-524eac10c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75e0d10a-6d99-46d7-b9a9-a647141cc346', 'volume_name': 'volume-75e0d10a-6d99-46d7-b9a9-a647141cc346', 'volume_size': 1, 'snapshot_id': '5ee0a62e-6116-46d3-8c79-4d9a2ac6b492'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e325a0-4f6a-458d-9746-43bbe06d6505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e325a0-4f6a-458d-9746-43bbe06d6505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355bfb8b-9286-4fe2-8e90-fef5191559b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:04 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Volume 75e0d10a-6d99-46d7-b9a9-a647141cc346: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75e0d10a-6d99-46d7-b9a9-a647141cc346', 'volume_size': 1, 'snapshot_id': '5ee0a62e-6116-46d3-8c79-4d9a2ac6b492'} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492-75e0d10a-6d99-46d7-b9a9-a647141cc346" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492-75e0d10a-6d99-46d7-b9a9-a647141cc346" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Creating volume 75e0d10a-6d99-46d7-b9a9-a647141cc346 from snapshot 5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-75e0d10a-6d99-46d7-b9a9-a647141cc346" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-75e0d10a-6d99-46d7-b9a9-a647141cc346" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] snapshot: 5ee0a62e-6116-46d3-8c79-4d9a2ac6b492, volume: 75e0d10a-6d99-46d7-b9a9-a647141cc346, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c15a51-7a27-41f8-9061-9c9382cb5494]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:04 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 Apr 13 14:17:04 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:04 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" returned: 0 in 0.691s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a75084a-23ce-4454-9da2-340c1e80926f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:04 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:17:04 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:05 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.721s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:05 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:17:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:05 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 Apr 13 14:17:05 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:08 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346" returned: 0 in 2.812s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a45b1-fed5-47d5-ab06-a001c5973365]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:08 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:17:08 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:08 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-fc097f61-2bab-47b6-936a-8fcde41fb5f0 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Terminate volume connection completed successfully. Apr 13 14:17:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-fc097f61-2bab-47b6-936a-8fcde41fb5f0 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Deleting attachment 6332608e-b4fc-4e03-a6e4-cabc73fe5dcd. {{(pid=82621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 14:17:09 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.902s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:17:09 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Converted 1024.00 MB image at 364.05 MB/s Apr 13 14:17:09 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 is being set with open permissions: ugo+rw Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "cinder-0cf2a638-404d-4f7c-b727-597afab87912-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:09 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-0cf2a638-404d-4f7c-b727-597afab87912-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:09 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "cinder-quobyte-0cf2a638-404d-4f7c-b727-597afab87912" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-quobyte-0cf2a638-404d-4f7c-b727-597afab87912" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2dcd8-bebd-46a4-97a0-4265ad35df65]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:09 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:17:09 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:09 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-75e0d10a-6d99-46d7-b9a9-a647141cc346" released by "_copy_volume_from_snapshot" :: held 5.737s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492-75e0d10a-6d99-46d7-b9a9-a647141cc346" released by "_create_volume_from_snapshot" :: held 5.761s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.771s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355bfb8b-9286-4fe2-8e90-fef5191559b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e0d10a-6d99-46d7-b9a9-a647141cc346', 'volume_size': 1, 'snapshot_id': '5ee0a62e-6116-46d3-8c79-4d9a2ac6b492'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead7e841-5419-4795-b921-a04fc72d6d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:09 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Volume volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 (75e0d10a-6d99-46d7-b9a9-a647141cc346): created successfully Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead7e841-5419-4795-b921-a04fc72d6d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Flow 'volume_create_manager' (5b625de6-7fed-4b5c-befd-c7e5091a33c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:09 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-aab8b9c8-94f5-4adc-b133-32b082c42574 tempest-VolumesSnapshotTestJSON-485997044 None] Created volume successfully. Apr 13 14:17:10 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 0 in 0.648s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:10 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:17:10 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-75e0d10a-6d99-46d7-b9a9-a647141cc346-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-75e0d10a-6d99-46d7-b9a9-a647141cc346-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-75e0d10a-6d99-46d7-b9a9-a647141cc346" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-75e0d10a-6d99-46d7-b9a9-a647141cc346" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c67ddc-f31b-41fd-b100-a3e4b2bbc127]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:10 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 Apr 13 14:17:10 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:10 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 1 in 0.724s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:17:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:10 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912 Apr 13 14:17:10 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:11 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346" returned: 0 in 0.630s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:11 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346 Apr 13 14:17:11 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Flow 'volume_create_manager' (cfc85f79-f212-4f31-8810-a67c7771b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d670f8-e221-401b-ada6-17208801abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d670f8-e221-401b-ada6-17208801abc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1088153543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01754a4e5f85435188a70502782499a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:11Z,use_quota=True,user_id='e562d5a7eae94f989edd3f49af241727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df17d91c-3562-490a-b359-dc85791fe2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df17d91c-3562-490a-b359-dc85791fe2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ad8a97-e7f5-4c1d-9da9-6a4d14801a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ad8a97-e7f5-4c1d-9da9-6a4d14801a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47', 'volume_name': 'volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec5af16-6362-46f6-9424-6ccdd9ea8091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec5af16-6362-46f6-9424-6ccdd9ea8091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4187a7-edac-4898-8c92-230860b2fb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:11 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Volume 07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47', 'volume_size': 1} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1088153543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01754a4e5f85435188a70502782499a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:11Z,use_quota=True,user_id='e562d5a7eae94f989edd3f49af241727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Creating volume 07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:11 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:11 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 1073741824 Apr 13 14:17:11 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:11 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0cf2a638-404d-4f7c-b727-597afab87912" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-quobyte-0cf2a638-404d-4f7c-b727-597afab87912" released by "delete_volume" :: held 1.991s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.quota [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Created reservations ['7ecda0c7-e7e0-41e4-886d-97d1b8e52d10', 'd7e8b8b1-a37e-45b9-9d17-3de5a8375d5a', 'ff9b30b5-9d0e-45ba-b7fc-bc10f863b850', '071435b2-23f6-47a6-98b0-be955a4e0381'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:11 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:11 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:11 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-75e0d10a-6d99-46d7-b9a9-a647141cc346" returned: 0 in 0.576s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-75e0d10a-6d99-46d7-b9a9-a647141cc346" released by "delete_volume" :: held 1.258s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['19c1eb97-7a07-4bcc-a356-f294f7cdf6f7', '900085fb-2c83-43c9-9cf6-5709ca0e7ce2', '18519715-1638-4110-b0cf-2632831e7baf', 'b1f06c24-52fe-4f93-8296-cbeb668f614c'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:11 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:11 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:12 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 1073741824" returned: 0 in 0.787s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:12 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 Apr 13 14:17:12 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:12 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.767s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.manager [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Deleted volume successfully. Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-2eb74747-25a2-4c09-ae86-8023f8ea160f req-073f73c8-b1da-44c0-8a3f-5db0479831c7 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-0cf2a638-404d-4f7c-b727-597afab87912-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:12 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.657s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Deleted volume successfully. Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-480b335b-cfae-453e-8b86-45040d0995d3 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-75e0d10a-6d99-46d7-b9a9-a647141cc346-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:12 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47" returned: 0 in 0.505s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4187a7-edac-4898-8c92-230860b2fb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b2d1c3-3edb-4354-9336-d392139e3416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:12 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Volume volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 (07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47): created successfully Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b2d1c3-3edb-4354-9336-d392139e3416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Flow 'volume_create_manager' (cfc85f79-f212-4f31-8810-a67c7771b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-731258da-94b9-490e-95ae-8351b8b831c6 req-2cd5b062-c78c-44c4-ae86-fa7548168ef3 tempest-VolumesGetTestJSON-2097833987 None] Created volume successfully. Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Deleting offline snapshot 5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 of volume ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] snapshot_file for this snap is: volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03874c3-425f-42e9-8cf4-9b5b3e83b1c8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:12 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 Apr 13 14:17:12 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:13 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" returned: 0 in 0.628s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92ea0d4-db63-4e29-ba56-8a5fdf4e07c9]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:13 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:17:13 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Acquiring lock "cinder-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Lock "cinder-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Acquiring lock "cinder-quobyte-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Lock "cinder-quobyte-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d4572e-b28e-42f0-b9a8-ee1050167886]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:13 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 Apr 13 14:17:13 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:14 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.744s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:14 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 Apr 13 14:17:14 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:14 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47" returned: 0 in 0.621s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:14 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47 Apr 13 14:17:14 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:14 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" returned: 0 in 0.639s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:14 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492 Apr 13 14:17:14 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:14 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47" returned: 0 in 0.589s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Lock "cinder-quobyte-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47" released by "delete_volume" :: held 1.238s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:14 devstack cinder-volume[82621]: DEBUG cinder.quota [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Created reservations ['7f556cfb-66ba-4dcf-ad87-384db9588489', '7e8e411e-b186-4291-a260-56f204b6ead2', 'f0cf5a50-693e-4b40-91e5-8d9ca21f98bc', '0b3ebd41-0814-4cd5-b422-a36a9eddae58'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:15 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:15 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:15 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2.5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" returned: 0 in 0.538s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492" released by "_delete_snapshot" :: held 2.654s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" released by "delete_snapshot" :: held 2.683s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['e461370a-32cd-4780-a26b-162c16d50130', 'e9d96191-3983-4c4b-8dcb-76575c053dfb', '4125532f-78f2-4551-a9e1-dc4148463476', '11d231b3-2bc3-4920-a92e-0d019e37fe98'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Delete snapshot completed successfully. Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f439500c-8438-4f29-bcb8-c2dd08e5a253 tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-5ee0a62e-6116-46d3-8c79-4d9a2ac6b492-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:15 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.637s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.manager [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Deleted volume successfully. Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-7789a1dd-c131-4ed2-85fa-32141c62716b req-7d424c48-929b-462d-9a1f-2b4ae3a66fe2 tempest-VolumesGetTestJSON-2097833987 None] Lock "cinder-07eb1c5f-4e3f-4f8f-b4bb-42402b02ba47-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:16 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54339b-2084-40e8-bc07-1fabca9c70bc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:16 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:17:16 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:16 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.703s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:16 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2 Apr 13 14:17:16 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:17 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" returned: 0 in 0.546s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2" released by "delete_volume" :: held 1.299s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['a099cf71-d59e-4b92-8c0e-4c62259c0429', '992cc5ee-fa58-4d0d-891c-c5a3624fe260', 'ed5e4ee2-a9c2-4138-b3a9-016318d0efb2', 'b533c6f2-af85-4a5e-92d7-3c8cf9c918d5'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:17 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:17 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:17 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.541s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:17 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Deleted volume successfully. Apr 13 14:17:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d479b725-3ff1-4df9-aeee-586225de7f6f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-ccfa44c9-c03a-4fd8-b8a0-b9bb4b6869d2-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-eff17a90-7db2-4295-a882-2b5119395ac0-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-eff17a90-7db2-4295-a882-2b5119395ac0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "cinder-quobyte-eff17a90-7db2-4295-a882-2b5119395ac0" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-eff17a90-7db2-4295-a882-2b5119395ac0" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91f6d1-781f-4bab-b315-cf29c603e2dd]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:18 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 Apr 13 14:17:18 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:18 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0" returned: 0 in 0.557s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:18 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0 Apr 13 14:17:18 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:19 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eff17a90-7db2-4295-a882-2b5119395ac0" returned: 0 in 0.585s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-quobyte-eff17a90-7db2-4295-a882-2b5119395ac0" released by "delete_volume" :: held 1.175s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Created reservations ['4824bd70-bb1f-4cd0-827e-f06a3f5ead1d', 'b346565e-4093-4953-ba57-0c4815b2e536', 'bed3b353-2d54-419f-8b39-9629caa0b2a8', 'ac8513e2-6409-4e2b-8bc6-d151c777228a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:19 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:19 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:19 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:19 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:20 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.628s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:20 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.538s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Deleted volume successfully. Apr 13 14:17:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c1682a21-c269-4673-934a-55ecf5f0b52f tempest-VolumesSnapshotTestJSON-485997044 None] Lock "cinder-eff17a90-7db2-4295-a882-2b5119395ac0-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-917ef392-03e4-4052-b7c3-3aceda161a43 tempest-GroupsV314Test-1029062202 None] Group tempest-GroupsV314Test-Group-2128185973: creating Apr 13 14:17:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-917ef392-03e4-4052-b7c3-3aceda161a43 tempest-GroupsV314Test-1029062202 None] Group tempest-GroupsV314Test-Group-2128185973: created successfully Apr 13 14:17:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-917ef392-03e4-4052-b7c3-3aceda161a43 tempest-GroupsV314Test-1029062202 None] Create group completed successfully. Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Flow 'volume_create_manager' (2a7ddc4b-abe3-435e-b54f-6b6c0ee5904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc564881-d6eb-49be-a3db-167a3822e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc564881-d6eb-49be-a3db-167a3822e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104001837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82442285-f046-43e3-b0ee-b561cddee15e,host='devstack@QuobyteHD#QuobyteHD',id=a238e425-f1b9-4665-8315-c076836d9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6862c9bc5c534428b53bbd7821d83118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:25Z,use_quota=True,user_id='b50c5424f6b44dbd8786287ee5d5062e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0649a83e-326a-4f1e-9c14-a84795d72266),volume_type_id=0649a83e-326a-4f1e-9c14-a84795d72266)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50daf33-30c0-41bc-9176-442638b1ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50daf33-30c0-41bc-9176-442638b1ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df242238-7673-4cf2-a86e-1ffb2eab191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df242238-7673-4cf2-a86e-1ffb2eab191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a238e425-f1b9-4665-8315-c076836d9146', 'volume_name': 'volume-a238e425-f1b9-4665-8315-c076836d9146', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d796b038-aa98-49e3-a1ac-5f6bee588359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d796b038-aa98-49e3-a1ac-5f6bee588359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11fc5c5-e9bd-4fcc-908d-38df7292e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:25 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Volume a238e425-f1b9-4665-8315-c076836d9146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a238e425-f1b9-4665-8315-c076836d9146', 'volume_size': 1} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=82442285-f046-43e3-b0ee-b561cddee15e,created_at=2026-04-13T12:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104001837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82442285-f046-43e3-b0ee-b561cddee15e,host='devstack@QuobyteHD#QuobyteHD',id=a238e425-f1b9-4665-8315-c076836d9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6862c9bc5c534428b53bbd7821d83118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:25Z,use_quota=True,user_id='b50c5424f6b44dbd8786287ee5d5062e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0649a83e-326a-4f1e-9c14-a84795d72266),volume_type_id=0649a83e-326a-4f1e-9c14-a84795d72266)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Creating volume a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:25 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:25 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 1073741824 Apr 13 14:17:25 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-fdcc1d12-94d9-41d5-9b49-a1d442cfe5c9 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Terminate volume connection completed successfully. Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-fdcc1d12-94d9-41d5-9b49-a1d442cfe5c9 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Deleting attachment 6559ec73-c95b-4564-9b7f-19ef6df2f111. {{(pid=82621) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 14:17:25 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 1073741824" returned: 0 in 0.663s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "cinder-7db932b3-0091-40b4-bb2e-b290d10792bd-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:25 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:25 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-7db932b3-0091-40b4-bb2e-b290d10792bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "cinder-quobyte-7db932b3-0091-40b4-bb2e-b290d10792bd" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-quobyte-7db932b3-0091-40b4-bb2e-b290d10792bd" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8535ece4-1e7c-41a0-af19-531ebe12ed52]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:26 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd Apr 13 14:17:26 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:26 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.758s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11fc5c5-e9bd-4fcc-908d-38df7292e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a238e425-f1b9-4665-8315-c076836d9146', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa458e36-09b9-4a67-bf02-2b92055c7bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:26 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Volume volume-a238e425-f1b9-4665-8315-c076836d9146 (a238e425-f1b9-4665-8315-c076836d9146): created successfully Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa458e36-09b9-4a67-bf02-2b92055c7bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Flow 'volume_create_manager' (2a7ddc4b-abe3-435e-b54f-6b6c0ee5904a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:26 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c5130591-97d0-4bf8-8173-3f6bd0b0b83d tempest-GroupsV314Test-1029062202 None] Created volume successfully. Apr 13 14:17:26 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd" returned: 0 in 0.767s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:26 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd Apr 13 14:17:26 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (6c011271-be0e-4231-a6d4-1a1f0a300778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7feec0f-278d-4de7-8325-cc1b2fa7fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7feec0f-278d-4de7-8325-cc1b2fa7fc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1784387186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc00e2ec-ac4a-41d1-aa53-358c68461204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd8ec14a74cb9825c526c101c99d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:27Z,use_quota=True,user_id='5fc93786fd154b54afa8d5d687f97efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fddbfb-4e6f-4622-ba81-0b45e2f7decd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fddbfb-4e6f-4622-ba81-0b45e2f7decd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff7af71-a1b5-4b1a-ae88-ef6ecbadf653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff7af71-a1b5-4b1a-ae88-ef6ecbadf653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc00e2ec-ac4a-41d1-aa53-358c68461204', 'volume_name': 'volume-dc00e2ec-ac4a-41d1-aa53-358c68461204', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76659292-5d2b-4a58-9a51-8a1c4ccb82ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76659292-5d2b-4a58-9a51-8a1c4ccb82ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17856a0b-5549-4ddb-8f91-29497d629d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:27 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Volume dc00e2ec-ac4a-41d1-aa53-358c68461204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc00e2ec-ac4a-41d1-aa53-358c68461204', 'volume_size': 1} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1784387186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc00e2ec-ac4a-41d1-aa53-358c68461204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd8ec14a74cb9825c526c101c99d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:27Z,use_quota=True,user_id='5fc93786fd154b54afa8d5d687f97efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Creating volume dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:27 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:27 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7db932b3-0091-40b4-bb2e-b290d10792bd" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-quobyte-7db932b3-0091-40b4-bb2e-b290d10792bd" released by "delete_volume" :: held 1.267s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:27 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 1073741824 Apr 13 14:17:27 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.quota [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Created reservations ['cd056156-af1d-42d5-a18f-bded379c03ea', 'c7ada714-d015-4c33-aa81-32819f510e04', 'd8da64f0-2fce-449d-823e-dd41cb39cfb9', 'a663f9d0-f3ea-4532-90d7-b0b4244dd3d0'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:27 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:27 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:27 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 1073741824" returned: 0 in 0.575s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:27 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:27 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:27 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.518s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.manager [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:27 devstack cinder-volume[82621]: INFO cinder.volume.manager [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Deleted volume successfully. Apr 13 14:17:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [req-b0ba1444-e115-4616-a3f3-6e273aa1f501 req-2567b27f-de87-40fc-a515-c25c3daaf7f8 tempest-ServerBootFromVolumeStableRescueTest-1044443502 None] Lock "cinder-7db932b3-0091-40b4-bb2e-b290d10792bd-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:28 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.072s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:28 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Cloning volume a238e425-f1b9-4665-8315-c076836d9146 to volume 7ae16177-1e0d-4285-be40-be5b71b47efc Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17856a0b-5549-4ddb-8f91-29497d629d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc00e2ec-ac4a-41d1-aa53-358c68461204', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba69c8d8-525e-48d4-adca-1c71dfa2044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:28 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Volume volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 (dc00e2ec-ac4a-41d1-aa53-358c68461204): created successfully Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba69c8d8-525e-48d4-adca-1c71dfa2044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (6c011271-be0e-4231-a6d4-1a1f0a300778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Creating offline snapshot 9515d749-07de-42f6-a022-df76506d5a63 of volume a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:17:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-61ac490d-17f4-4107-8af7-8ace6d301e5b tempest-VolumeDependencyTests-293344833 None] Created volume successfully. Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05884c35-0c13-4695-97b8-5b8d00738fa5]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:28 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:28 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:28 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.573s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:28 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 1G Apr 13 14:17:28 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:29 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 1G" returned: 0 in 0.623s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a238e425-f1b9-4665-8315-c076836d9146 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:29 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a238e425-f1b9-4665-8315-c076836d9146 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 Apr 13 14:17:29 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:30 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a238e425-f1b9-4665-8315-c076836d9146 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63" returned: 0 in 0.488s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:30 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:17:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:30 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 Apr 13 14:17:30 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:30 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:30 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info Apr 13 14:17:30 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:31 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info" returned: 0 in 0.439s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:31 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:31 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info Apr 13 14:17:31 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:31 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.info" returned: 0 in 0.442s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Acquiring lock "cinder-quobyte-7ae16177-1e0d-4285-be40-be5b71b47efc" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-7ae16177-1e0d-4285-be40-be5b71b47efc" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] snapshot: 9515d749-07de-42f6-a022-df76506d5a63, volume: 7ae16177-1e0d-4285-be40-be5b71b47efc, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb758eff-1020-43f0-b82f-ede1e4dc4368]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:31 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 Apr 13 14:17:31 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:32 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63" returned: 0 in 0.585s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a238e425-f1b9-4665-8315-c076836d9146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff83a13-e56d-44ae-968d-8b03e74bf538]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:32 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:32 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:32 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.543s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:17:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:32 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc Apr 13 14:17:32 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:35 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc" returned: 0 in 2.537s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:35 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4002312d-d75a-4016-b640-9b3389623aeb]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:35 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:35 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:35 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.640s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:35 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:17:35 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Converted 1024.00 MB image at 403.44 MB/s Apr 13 14:17:35 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:17:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:35 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc Apr 13 14:17:35 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:36 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc" returned: 0 in 0.504s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-7ae16177-1e0d-4285-be40-be5b71b47efc" released by "_copy_volume_from_snapshot" :: held 4.871s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=118,cinder:INSERT=30,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Acquiring lock "cinder-quobyte-9515d749-07de-42f6-a022-df76506d5a63" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-9515d749-07de-42f6-a022-df76506d5a63" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Deleting offline snapshot 9515d749-07de-42f6-a022-df76506d5a63 of volume a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] snapshot_file for this snap is: volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc3ace-2588-4d9d-ad3e-7b51eefad856]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:36 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 Apr 13 14:17:36 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:36 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63" returned: 0 in 0.554s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a238e425-f1b9-4665-8315-c076836d9146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d956d-c4ef-40a6-a71c-b00ac4bf4770]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:37 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:37 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:37 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.643s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:37 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 Apr 13 14:17:37 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:38 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63" returned: 0 in 0.587s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:38 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63 Apr 13 14:17:38 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:38 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146.9515d749-07de-42f6-a022-df76506d5a63" returned: 0 in 0.509s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-9515d749-07de-42f6-a022-df76506d5a63" released by "_delete_snapshot" :: held 2.343s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=109,cinder:UPDATE=152,cinder:DELETE=14,cinder:INSERT=38 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.477s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.348s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Creating offline snapshot f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f of volume dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24031043-4410-4331-8055-84f994c2da7f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:38 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d3d65aa0-ae76-406d-9ec7-3ef33c73b3c2 tempest-GroupsV314Test-1029062202 None] Create group from source-group-82442285-f046-43e3-b0ee-b561cddee15e completed successfully. Apr 13 14:17:38 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:38 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:39 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:39 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f 1G Apr 13 14:17:39 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Acquiring lock "cinder-quobyte-7ae16177-1e0d-4285-be40-be5b71b47efc" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-7ae16177-1e0d-4285-be40-be5b71b47efc" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:39 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f7843e-afcb-4aa1-beeb-c6e0a57b3f3a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:39 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc Apr 13 14:17:39 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:40 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f 1G" returned: 0 in 0.690s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Flow 'volume_create_manager' (f278436e-6ee3-4750-9392-4d4444c3b5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:40 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f Apr 13 14:17:40 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355a9d6c-f338-4eff-9425-2756792fb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:40 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355a9d6c-f338-4eff-9425-2756792fb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807780001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fa7f9-a943-485a-870b-571471e60240,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ec63d3881bd462a88ed0cfe040da528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:40Z,use_quota=True,user_id='df59f5036d9d4b789c2a77246a8cea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274b3eb1-dcdd-4192-9235-216d0f585a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274b3eb1-dcdd-4192-9235-216d0f585a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d922dc-6159-405e-a351-382997cd03ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d922dc-6159-405e-a351-382997cd03ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76fa7f9-a943-485a-870b-571471e60240', 'volume_name': 'volume-c76fa7f9-a943-485a-870b-571471e60240', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b86b55-e9c5-48cd-95ab-cbeba6a9fb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b86b55-e9c5-48cd-95ab-cbeba6a9fb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40894d05-9a2b-447a-b670-1b817885e2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Volume c76fa7f9-a943-485a-870b-571471e60240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76fa7f9-a943-485a-870b-571471e60240', 'volume_size': 1} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc" returned: 0 in 0.850s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:40 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc Apr 13 14:17:40 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:40 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" returned: 0 in 0.901s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:40 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f is being set with open permissions: ugo+rw Apr 13 14:17:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:41 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7ae16177-1e0d-4285-be40-be5b71b47efc" returned: 0 in 0.641s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:41 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f Apr 13 14:17:41 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-7ae16177-1e0d-4285-be40-be5b71b47efc" released by "delete_volume" :: held 1.527s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Created reservations ['248cb9c0-0fd9-4f45-80a4-8febf942d70c'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:41 devstack cinder-volume[82621]: WARNING cinder.quota [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1476503135 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1476503135, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:17:41 devstack cinder-volume[82621]: WARNING cinder.quota [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1476503135 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1476503135, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Created reservations ['981551d1-b634-4c8c-a382-35b6cdedaa87', 'fc61a663-e811-407d-8996-afe9242d2522', '1ac3e98c-22e5-40ca-bf99-acfd608ce9a2', '9436199e-ee22-49e3-aa85-e614ea7d098c'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:41 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:41 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:41 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" returned: 0 in 0.569s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:41 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info Apr 13 14:17:41 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:41 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:41 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:41 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-77ce1bd6-a3bb-4482-8181-1a492e047ebf tempest-GroupsV314Test-1029062202 None] Delete group completed successfully. Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Acquiring lock "cinder-quobyte-a238e425-f1b9-4665-8315-c076836d9146" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-a238e425-f1b9-4665-8315-c076836d9146" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:42 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info" returned: 0 in 0.574s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:42 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info is being set with open permissions: ugo+rw Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[93feb3eb-f819-474e-8efd-40c767778c5a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:42 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info Apr 13 14:17:42 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:42 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:42 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:42 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.info" returned: 0 in 0.527s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.934s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.360s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807780001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76fa7f9-a943-485a-870b-571471e60240,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ec63d3881bd462a88ed0cfe040da528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:40Z,use_quota=True,user_id='df59f5036d9d4b789c2a77246a8cea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Creating volume c76fa7f9-a943-485a-870b-571471e60240 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:42 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:42 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 1073741824 Apr 13 14:17:42 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-23ba24b5-2347-4589-b233-14538aa3ead1 tempest-VolumeDependencyTests-293344833 None] Create snapshot completed successfully Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (539d80c0-28e4-4ba9-aeeb-ea1d80d8a8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8785c02a-42c8-4097-8926-5a269d2aeeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8785c02a-42c8-4097-8926-5a269d2aeeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644543180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf2d164-580b-4708-8b45-d1aab4984974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:43Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68aa16ce-0795-49ef-b998-9c7c50fca06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:42 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68aa16ce-0795-49ef-b998-9c7c50fca06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78660eaf-17e7-406b-9745-452ae75899d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78660eaf-17e7-406b-9745-452ae75899d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf2d164-580b-4708-8b45-d1aab4984974', 'volume_name': 'volume-1bf2d164-580b-4708-8b45-d1aab4984974', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694d0e73-179d-483e-bc76-12183dbf86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694d0e73-179d-483e-bc76-12183dbf86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064ef623-2cf8-46be-b315-dbf32fd674ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Volume 1bf2d164-580b-4708-8b45-d1aab4984974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf2d164-580b-4708-8b45-d1aab4984974', 'volume_size': 1} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.686s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:42 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146 Apr 13 14:17:42 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:43 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 1073741824" returned: 0 in 0.725s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:43 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 Apr 13 14:17:43 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (0e614a79-acc4-4fc2-aa3a-39592f1e94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:43 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd68cc87-97f6-4bce-9eba-f577c88235d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd68cc87-97f6-4bce-9eba-f577c88235d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1200769724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7548ca89-1439-49e6-aa06-87b407b72cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd8ec14a74cb9825c526c101c99d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:43Z,use_quota=True,user_id='5fc93786fd154b54afa8d5d687f97efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ca784-299f-4637-960e-278c7495edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ca784-299f-4637-960e-278c7495edc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428cfbc7-a7bf-40d8-8037-ae051db6e9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428cfbc7-a7bf-40d8-8037-ae051db6e9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7548ca89-1439-49e6-aa06-87b407b72cdc', 'volume_name': 'volume-7548ca89-1439-49e6-aa06-87b407b72cdc', 'volume_size': 1, 'snapshot_id': 'f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6ed6ad-5c48-49a4-b7e2-da4a06bc5566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6ed6ad-5c48-49a4-b7e2-da4a06bc5566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e866b894-c4b5-4a17-bda2-9e6c619f98a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:43 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Volume 7548ca89-1439-49e6-aa06-87b407b72cdc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7548ca89-1439-49e6-aa06-87b407b72cdc', 'volume_size': 1, 'snapshot_id': 'f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f'} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a238e425-f1b9-4665-8315-c076836d9146" returned: 0 in 0.724s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Lock "cinder-quobyte-a238e425-f1b9-4665-8315-c076836d9146" released by "delete_volume" :: held 1.492s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Created reservations ['326eac23-82fe-45bb-9b7b-b48cf6896965'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Created reservations ['2a57f773-9463-436a-9b80-91457e956cc1', '96a4a2b2-9eb0-464b-bd9e-b7efcdb0e44f', 'e83368ce-581d-4945-8ce9-67b6de3d9043', 'b9d88500-baec-4c7f-a040-d9221c316572'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:43 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:43 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:43 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644543180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf2d164-580b-4708-8b45-d1aab4984974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:43Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Creating volume 1bf2d164-580b-4708-8b45-d1aab4984974 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:43 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40894d05-9a2b-447a-b670-1b817885e2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76fa7f9-a943-485a-870b-571471e60240', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943334bb-f779-4614-b6d5-26c890b27e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:44 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 1073741824 Apr 13 14:17:44 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Volume volume-c76fa7f9-a943-485a-870b-571471e60240 (c76fa7f9-a943-485a-870b-571471e60240): created successfully Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943334bb-f779-4614-b6d5-26c890b27e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Flow 'volume_create_manager' (f278436e-6ee3-4750-9392-4d4444c3b5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-84896cbd-3f07-4d47-8855-46c26c3e101a tempest-VolumesTestJSON-1642443399 None] Created volume successfully. Apr 13 14:17:44 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.444s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bcbaf230-6261-40ad-b230-ca7cf909b0f7 tempest-GroupsV314Test-1029062202 None] Delete group completed successfully. Apr 13 14:17:44 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 1073741824" returned: 0 in 0.583s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:44 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 Apr 13 14:17:44 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Flow 'volume_create_manager' (6d37e95f-26a5-4a9c-96d7-4829bf060476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281341f7-bb3e-4d72-99d0-1b621f21db4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281341f7-bb3e-4d72-99d0-1b621f21db4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1410825476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd87996a-fd4a-45fd-adee-f153adda6666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ec63d3881bd462a88ed0cfe040da528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:45Z,use_quota=True,user_id='df59f5036d9d4b789c2a77246a8cea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d639f43a-6e72-47a7-a72e-6b11dbd36864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d639f43a-6e72-47a7-a72e-6b11dbd36864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99428913-ffd1-4adc-aaf3-da60ecdd23ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99428913-ffd1-4adc-aaf3-da60ecdd23ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd87996a-fd4a-45fd-adee-f153adda6666', 'volume_name': 'volume-fd87996a-fd4a-45fd-adee-f153adda6666', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef95313-12a8-41cd-a0de-cda59b4a7c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef95313-12a8-41cd-a0de-cda59b4a7c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3875407-196d-461a-8397-7187088af1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Volume fd87996a-fd4a-45fd-adee-f153adda6666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd87996a-fd4a-45fd-adee-f153adda6666', 'volume_size': 1} Apr 13 14:17:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:45 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974" returned: 0 in 0.496s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.509s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f-7548ca89-1439-49e6-aa06-87b407b72cdc" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064ef623-2cf8-46be-b315-dbf32fd674ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf2d164-580b-4708-8b45-d1aab4984974', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca31182-b5d0-4a4e-838e-aa34e8b52b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:45 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Volume volume-1bf2d164-580b-4708-8b45-d1aab4984974 (1bf2d164-580b-4708-8b45-d1aab4984974): created successfully Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca31182-b5d0-4a4e-838e-aa34e8b52b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (539d80c0-28e4-4ba9-aeeb-ea1d80d8a8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f-7548ca89-1439-49e6-aa06-87b407b72cdc" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Creating volume 7548ca89-1439-49e6-aa06-87b407b72cdc from snapshot f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-7548ca89-1439-49e6-aa06-87b407b72cdc" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-7548ca89-1439-49e6-aa06-87b407b72cdc" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] snapshot: f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f, volume: 7548ca89-1439-49e6-aa06-87b407b72cdc, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3a283495-bc49-4e8e-9bcb-91c041869cfb tempest-VolumesActionsTest-237866144 None] Created volume successfully. Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0f1f16-0ecb-4e00-b2e6-75afd502a206]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:45 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f Apr 13 14:17:45 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:45 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" returned: 0 in 0.548s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc00e2ec-ac4a-41d1-aa53-358c68461204(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[585bd163-d498-4bb1-b0b3-6a2775161076]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:45 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:45 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d28a71d5-28f0-434e-a39e-2c275ed7e59f tempest-VolumesActionsTest-237866144 None] Acquiring lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974" by "attach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d28a71d5-28f0-434e-a39e-2c275ed7e59f tempest-VolumesActionsTest-237866144 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974" acquired by "attach_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d28a71d5-28f0-434e-a39e-2c275ed7e59f tempest-VolumesActionsTest-237866144 None] Attaching volume 1bf2d164-580b-4708-8b45-d1aab4984974 to instance 1266756d-2252-4823-830e-6d6d54e7350e at mountpoint /dev/vdb on host None. Apr 13 14:17:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d28a71d5-28f0-434e-a39e-2c275ed7e59f tempest-VolumesActionsTest-237866144 None] Attach volume completed successfully. Apr 13 14:17:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d28a71d5-28f0-434e-a39e-2c275ed7e59f tempest-VolumesActionsTest-237866144 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974" released by "attach_volume" :: held 0.104s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:46 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.528s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:46 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:17:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:46 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc Apr 13 14:17:46 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6e252eb4-c232-44a5-8e6c-f7851d75c07e tempest-VolumesActionsTest-1463682367 None] Terminate volume connection completed successfully. Apr 13 14:17:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e252eb4-c232-44a5-8e6c-f7851d75c07e tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-detach_volume" by "detach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e252eb4-c232-44a5-8e6c-f7851d75c07e tempest-VolumesActionsTest-1463682367 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6e252eb4-c232-44a5-8e6c-f7851d75c07e tempest-VolumesActionsTest-1463682367 None] Detaching volume 1bf2d164-580b-4708-8b45-d1aab4984974 from instance 1266756d-2252-4823-830e-6d6d54e7350e. Apr 13 14:17:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6e252eb4-c232-44a5-8e6c-f7851d75c07e tempest-VolumesActionsTest-1463682367 None] Detach volume completed successfully. Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e252eb4-c232-44a5-8e6c-f7851d75c07e tempest-VolumesActionsTest-1463682367 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-detach_volume" released by "detach_volume" :: held 0.404s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1c240751-ed4b-4c0b-8433-d5339797e859 tempest-VolumesActionsTest-237866144 None] Acquiring lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-detach_volume" by "detach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1c240751-ed4b-4c0b-8433-d5339797e859 tempest-VolumesActionsTest-237866144 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1c240751-ed4b-4c0b-8433-d5339797e859 tempest-VolumesActionsTest-237866144 None] Volume detach called, but volume not attached. Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1c240751-ed4b-4c0b-8433-d5339797e859 tempest-VolumesActionsTest-237866144 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:48 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc" returned: 0 in 2.655s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99583b8c-0d52-4410-8ee0-0e06a9b40186]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:49 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:49 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Acquiring lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Acquiring lock "cinder-quobyte-1bf2d164-580b-4708-8b45-d1aab4984974" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Lock "cinder-quobyte-1bf2d164-580b-4708-8b45-d1aab4984974" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f76b13-a28c-4125-9d67-ad5db0270bc4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:49 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 Apr 13 14:17:49 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:49 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.672s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:17:49 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Converted 1024.00 MB image at 385.38 MB/s Apr 13 14:17:49 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc is being set with open permissions: ugo+rw Apr 13 14:17:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:49 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc Apr 13 14:17:49 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:50 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:50 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-7548ca89-1439-49e6-aa06-87b407b72cdc" released by "_copy_volume_from_snapshot" :: held 4.892s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:50 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974 Apr 13 14:17:50 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f-7548ca89-1439-49e6-aa06-87b407b72cdc" released by "_create_volume_from_snapshot" :: held 4.914s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.951s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.094s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1410825476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd87996a-fd4a-45fd-adee-f153adda6666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ec63d3881bd462a88ed0cfe040da528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:45Z,use_quota=True,user_id='df59f5036d9d4b789c2a77246a8cea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Creating volume fd87996a-fd4a-45fd-adee-f153adda6666 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:50 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e866b894-c4b5-4a17-bda2-9e6c619f98a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7548ca89-1439-49e6-aa06-87b407b72cdc', 'volume_size': 1, 'snapshot_id': 'f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73469ad0-7e6f-4017-95fd-fa42acd98285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:50 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Volume volume-7548ca89-1439-49e6-aa06-87b407b72cdc (7548ca89-1439-49e6-aa06-87b407b72cdc): created successfully Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73469ad0-7e6f-4017-95fd-fa42acd98285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:50 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 1073741824 Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (0e614a79-acc4-4fc2-aa3a-39592f1e94be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:50 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-964f51b0-be3c-4ea3-b51a-79859919a192 tempest-VolumeDependencyTests-293344833 None] Created volume successfully. Apr 13 14:17:50 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1bf2d164-580b-4708-8b45-d1aab4984974" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Lock "cinder-quobyte-1bf2d164-580b-4708-8b45-d1aab4984974" released by "delete_volume" :: held 0.988s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Created reservations ['5dfb1f56-0aae-4f9a-9b7c-69b36ad44d21', 'e3f3e0ca-8f4a-4e95-87bc-389f2371d8fc', 'fb4f0e0e-0add-4182-ad50-cf246458fb96', '6aa1f65f-8549-41de-9ecc-789446265ef3'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:50 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:50 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:50 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 1073741824" returned: 0 in 0.711s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:50 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 Apr 13 14:17:50 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:51 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.662s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:51 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Deleted volume successfully. Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-efff493f-bb76-473c-8891-e594bbead6d0 tempest-VolumesActionsTest-237866144 None] Lock "cinder-1bf2d164-580b-4708-8b45-d1aab4984974-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-dc00e2ec-ac4a-41d1-aa53-358c68461204" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-dc00e2ec-ac4a-41d1-aa53-358c68461204" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Deleting offline snapshot f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f of volume dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] snapshot_file for this snap is: volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d397969d-6528-4f2d-a716-fe743446559c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:51 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666" returned: 0 in 0.633s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:51 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f Apr 13 14:17:51 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3875407-196d-461a-8397-7187088af1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd87996a-fd4a-45fd-adee-f153adda6666', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1a7df6-7e16-450a-bcc7-18f8a59e298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:51 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Volume volume-fd87996a-fd4a-45fd-adee-f153adda6666 (fd87996a-fd4a-45fd-adee-f153adda6666): created successfully Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1a7df6-7e16-450a-bcc7-18f8a59e298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Flow 'volume_create_manager' (6d37e95f-26a5-4a9c-96d7-4829bf060476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:51 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8a1a7ac0-a740-4fc0-a9f3-ca7e6b33b369 tempest-VolumesTestJSON-1642443399 None] Created volume successfully. Apr 13 14:17:52 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" returned: 0 in 0.685s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc00e2ec-ac4a-41d1-aa53-358c68461204(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d93064e-dd38-4702-b8ea-5537b448b11d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:52 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:52 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Flow 'volume_create_manager' (89ca57f7-69ff-498a-aedf-72c11ce61257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f11f95-4270-40c3-a02e-38cf2cf1c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f11f95-4270-40c3-a02e-38cf2cf1c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-856709019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a10a624-a67b-4972-86f3-1d5b776f9dc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ec63d3881bd462a88ed0cfe040da528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:52Z,use_quota=True,user_id='df59f5036d9d4b789c2a77246a8cea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfe8246-db14-4253-8c6a-cb118ddf60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfe8246-db14-4253-8c6a-cb118ddf60a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19ad094-da56-468e-a891-73457f62ed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19ad094-da56-468e-a891-73457f62ed44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a10a624-a67b-4972-86f3-1d5b776f9dc5', 'volume_name': 'volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdd43ec-0cfc-4186-b9ab-b897ff0f10d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdd43ec-0cfc-4186-b9ab-b897ff0f10d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce49a22-4b43-4dd2-96a6-05cbbfa20e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:52 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Volume 2a10a624-a67b-4972-86f3-1d5b776f9dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5', 'volume_size': 1} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-856709019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a10a624-a67b-4972-86f3-1d5b776f9dc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ec63d3881bd462a88ed0cfe040da528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:52Z,use_quota=True,user_id='df59f5036d9d4b789c2a77246a8cea2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Creating volume 2a10a624-a67b-4972-86f3-1d5b776f9dc5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:52 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:52 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 1073741824 Apr 13 14:17:52 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:52 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.587s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:52 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f Apr 13 14:17:52 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:53 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 1073741824" returned: 0 in 0.647s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:53 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 Apr 13 14:17:53 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:53 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" returned: 0 in 0.556s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:53 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f Apr 13 14:17:53 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:53 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5" returned: 0 in 0.561s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce49a22-4b43-4dd2-96a6-05cbbfa20e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:53 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8613d5d-b373-44c9-84a2-80cc85120b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204.f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" returned: 0 in 0.510s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:53 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Volume volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 (2a10a624-a67b-4972-86f3-1d5b776f9dc5): created successfully Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8613d5d-b373-44c9-84a2-80cc85120b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Flow 'volume_create_manager' (89ca57f7-69ff-498a-aedf-72c11ce61257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f5147d23-4340-4493-92da-1bb673cb6a1e tempest-VolumesTestJSON-1642443399 None] Created volume successfully. Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f" released by "_delete_snapshot" :: held 2.431s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-dc00e2ec-ac4a-41d1-aa53-358c68461204" released by "delete_snapshot" :: held 2.452s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Created reservations ['195a1088-d1bb-4bc7-9860-633f7458a3d6', '90c36d53-b358-4561-9169-aceafcfc8f74', 'bf70d5e2-a2ae-4359-ac81-3e7b2637b52a', '2d5a7db2-2a73-40e2-bbc4-a1ef4562b73a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Delete snapshot completed successfully. Apr 13 14:17:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41b35cc6-5512-4d42-8a7d-349e0852b565 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-f7e5fc43-f3bf-4378-aa3e-ddb8ae2ffb4f-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-dc00e2ec-ac4a-41d1-aa53-358c68461204-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-dc00e2ec-ac4a-41d1-aa53-358c68461204-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-dc00e2ec-ac4a-41d1-aa53-358c68461204" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-dc00e2ec-ac4a-41d1-aa53-358c68461204" acquired by "delete_volume" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:54 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4cd080-3c60-42ce-a4bb-54f7b04224e4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:54 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:54 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:55 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.625s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:55 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204 Apr 13 14:17:55 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "cinder-2a10a624-a67b-4972-86f3-1d5b776f9dc5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-2a10a624-a67b-4972-86f3-1d5b776f9dc5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "cinder-quobyte-2a10a624-a67b-4972-86f3-1d5b776f9dc5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-quobyte-2a10a624-a67b-4972-86f3-1d5b776f9dc5" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5a829-b996-4b41-b997-32d7c1210c84]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:55 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 Apr 13 14:17:55 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:55 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dc00e2ec-ac4a-41d1-aa53-358c68461204" returned: 0 in 0.505s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-dc00e2ec-ac4a-41d1-aa53-358c68461204" released by "delete_volume" :: held 1.163s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Created reservations ['59251fbd-79bf-4186-95fe-7c9545156cf4', '0af83289-1349-4974-aecc-ad85b79a43ff', '57d6c8ae-769b-4c7f-a578-82197f83c474', '34fc8be6-f814-4076-b92a-d72860de7683'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:55 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:55 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:56 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5" returned: 0 in 0.580s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:56 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5 Apr 13 14:17:56 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:56 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:56 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Deleted volume successfully. Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-65683b94-ef1b-4eb6-98df-17dd46a502f6 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-dc00e2ec-ac4a-41d1-aa53-358c68461204-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:56 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2a10a624-a67b-4972-86f3-1d5b776f9dc5" returned: 0 in 0.483s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-quobyte-2a10a624-a67b-4972-86f3-1d5b776f9dc5" released by "delete_volume" :: held 1.086s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Created reservations ['7a7a060f-8a72-4321-a891-748bd0953c80', '0ce91fe4-b745-4afc-976b-3c45b290ec07', '19eb4419-660e-4cba-8343-fb9834acd52c', '98487d96-9794-4c68-9cf8-16ad4a366b59'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:56 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:56 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (8298a548-5d26-4c95-b185-c5aff870bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a193222-2b2c-4f5d-9130-ceb8c8ec8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a193222-2b2c-4f5d-9130-ceb8c8ec8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-700831933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b006f2-6c5f-48ed-bf9a-59d2851ab264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd8ec14a74cb9825c526c101c99d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:57Z,use_quota=True,user_id='5fc93786fd154b54afa8d5d687f97efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e7198d-b27d-45d2-97b5-31b8ee68d667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e7198d-b27d-45d2-97b5-31b8ee68d667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378031c7-3269-4d04-a824-622343982b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378031c7-3269-4d04-a824-622343982b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'volume_name': 'volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b8a7f-afc4-4b5e-afca-f55a823c0464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b8a7f-afc4-4b5e-afca-f55a823c0464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0921b349-7e83-4c56-b0aa-7a53a7348008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Volume a7b006f2-6c5f-48ed-bf9a-59d2851ab264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'volume_size': 1} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-700831933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b006f2-6c5f-48ed-bf9a-59d2851ab264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd8ec14a74cb9825c526c101c99d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:57Z,use_quota=True,user_id='5fc93786fd154b54afa8d5d687f97efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Creating volume a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:57 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:57 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 1073741824 Apr 13 14:17:57 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:57 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.553s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Deleted volume successfully. Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-24f30ddf-9691-43d9-8a7e-44ab00fc77a6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-2a10a624-a67b-4972-86f3-1d5b776f9dc5-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (e677297b-0f97-49c8-92d5-dfcf541a62e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56be31d6-6bd9-4878-9dba-84ce98556c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56be31d6-6bd9-4878-9dba-84ce98556c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-649993322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759ae12f-e091-42d0-98a1-e987da927617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:57Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2480cd-e49e-4c20-afaf-392b44a4d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2480cd-e49e-4c20-afaf-392b44a4d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e232ce-e931-47d2-9780-b9cc6362c740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e232ce-e931-47d2-9780-b9cc6362c740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759ae12f-e091-42d0-98a1-e987da927617', 'volume_name': 'volume-759ae12f-e091-42d0-98a1-e987da927617', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9957d9-7fd7-4ff9-9956-00a259056f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9957d9-7fd7-4ff9-9956-00a259056f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10f537a-492d-4092-9bbb-ae7f3590f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:57 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Volume 759ae12f-e091-42d0-98a1-e987da927617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759ae12f-e091-42d0-98a1-e987da927617', 'volume_size': 1} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "cinder-fd87996a-fd4a-45fd-adee-f153adda6666-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-fd87996a-fd4a-45fd-adee-f153adda6666-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "cinder-quobyte-fd87996a-fd4a-45fd-adee-f153adda6666" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-quobyte-fd87996a-fd4a-45fd-adee-f153adda6666" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d2165-e088-4da9-baac-b4d19b2f0dd9]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:57 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 1073741824" returned: 0 in 0.623s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:57 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:17:57 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:57 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 Apr 13 14:17:57 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:58 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666" returned: 0 in 0.508s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:58 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666 Apr 13 14:17:58 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:58 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.509s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-649993322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759ae12f-e091-42d0-98a1-e987da927617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:57Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Creating volume 759ae12f-e091-42d0-98a1-e987da927617 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:17:58 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0921b349-7e83-4c56-b0aa-7a53a7348008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:58 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 1073741824 Apr 13 14:17:58 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d034ce-51e2-46f3-9ded-8d0a562f5dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:58 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Volume volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 (a7b006f2-6c5f-48ed-bf9a-59d2851ab264): created successfully Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d034ce-51e2-46f3-9ded-8d0a562f5dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (8298a548-5d26-4c95-b185-c5aff870bc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2ac7ef7e-9c6e-4de1-8ca3-62486451a494 tempest-VolumeDependencyTests-293344833 None] Created volume successfully. Apr 13 14:17:58 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fd87996a-fd4a-45fd-adee-f153adda6666" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-quobyte-fd87996a-fd4a-45fd-adee-f153adda6666" released by "delete_volume" :: held 1.029s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Created reservations ['4d59c987-daec-45a7-a08c-ec465fd60c27', '02d3373e-a0e4-4e1b-a9ef-02b234352ea1', '62b89644-72a3-455b-b415-8697b8be51c7', '5a4f9f02-aa9d-4cd0-aee8-1edc5ecf4f8b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:58 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:17:58 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:58 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 1073741824" returned: 0 in 0.596s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:58 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 Apr 13 14:17:58 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:59 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:17:59 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Deleted volume successfully. Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-73936624-9a5e-48d0-b38b-50df394dafe0 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-fd87996a-fd4a-45fd-adee-f153adda6666-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (d80fe400-de6b-4aa7-a30f-40e7b5cd58c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4adf58b-419b-47f2-b84e-6599d2767122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:59 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4adf58b-419b-47f2-b84e-6599d2767122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1255853066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a350c953-040b-4d39-a90c-965d777f24f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303bd8ec14a74cb9825c526c101c99d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a7b006f2-6c5f-48ed-bf9a-59d2851ab264,status='creating',terminated_at=None,updated_at=2026-04-13T12:17:59Z,use_quota=True,user_id='5fc93786fd154b54afa8d5d687f97efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39f82d1-24b7-44ff-9ae3-53ba3e9f316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39f82d1-24b7-44ff-9ae3-53ba3e9f316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3773d77-9f4c-4337-93bf-e3ced4757624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3773d77-9f4c-4337-93bf-e3ced4757624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a350c953-040b-4d39-a90c-965d777f24f1', 'volume_name': 'volume-a350c953-040b-4d39-a90c-965d777f24f1', 'volume_size': 1, 'source_volid': 'a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f7a095-246b-47f3-8cd3-5a200d2290d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f7a095-246b-47f3-8cd3-5a200d2290d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1cc0ee-e1cb-4bf2-a308-a3ffc5c48ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:59 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Volume a350c953-040b-4d39-a90c-965d777f24f1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a350c953-040b-4d39-a90c-965d777f24f1', 'volume_size': 1, 'source_volid': 'a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'source_volstatus': 'available'} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617" returned: 0 in 0.520s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:17:59 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Cloning volume a7b006f2-6c5f-48ed-bf9a-59d2851ab264 to volume a350c953-040b-4d39-a90c-965d777f24f1 Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10f537a-492d-4092-9bbb-ae7f3590f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759ae12f-e091-42d0-98a1-e987da927617', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf135f70-3798-418f-9dfd-0bf2bc17c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Creating offline snapshot 1b22ca6d-9859-4802-a38f-655ef6469834 of volume a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:17:59 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Volume volume-759ae12f-e091-42d0-98a1-e987da927617 (759ae12f-e091-42d0-98a1-e987da927617): created successfully Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf135f70-3798-418f-9dfd-0bf2bc17c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (e677297b-0f97-49c8-92d5-dfcf541a62e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[62618056-26c1-4d62-93bc-057ba6360402]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:59 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-55636ca3-a31f-4580-a2de-3031f8379aa1 tempest-VolumesActionsTest-237866144 None] Created volume successfully. Apr 13 14:17:59 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:17:59 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "cinder-c76fa7f9-a943-485a-870b-571471e60240-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-c76fa7f9-a943-485a-870b-571471e60240-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "cinder-quobyte-c76fa7f9-a943-485a-870b-571471e60240" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-quobyte-c76fa7f9-a943-485a-870b-571471e60240" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[308446bf-bc70-42de-bb61-40565e1af08b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:17:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:17:59 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 Apr 13 14:17:59 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:00 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.596s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:00 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 1G Apr 13 14:18:00 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:00 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:00 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240 Apr 13 14:18:00 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-759ae12f-e091-42d0-98a1-e987da927617-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:00 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 1G" returned: 0 in 0.602s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Lock "cinder-759ae12f-e091-42d0-98a1-e987da927617-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:00 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 Apr 13 14:18:00 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-quobyte-759ae12f-e091-42d0-98a1-e987da927617" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-759ae12f-e091-42d0-98a1-e987da927617" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54686f1-e8a0-43e9-96fb-f333b62a5e53]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:00 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 Apr 13 14:18:00 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:00 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-c76fa7f9-a943-485a-870b-571471e60240" returned: 0 in 0.531s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-quobyte-c76fa7f9-a943-485a-870b-571471e60240" released by "delete_volume" :: held 1.123s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Created reservations ['ce415a06-05f0-4338-ab72-40383cc41800', '5ec26ca4-2b3c-483a-aa3b-96f8898e08f9', '99837bce-4e29-47a8-a874-9507ec10fe6f', '762b8ba0-c9dd-4b79-ac74-14a6a5b2c854'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:01 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:01 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:01 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834" returned: 0 in 0.561s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:01 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 is being set with open permissions: ugo+rw Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:01 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 Apr 13 14:18:01 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Flow 'volume_create_manager' (1497e979-2f2e-4f37-a46c-0018acdb26e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f27ea2-e0b5-4fe6-a1a6-2017a4def38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f27ea2-e0b5-4fe6-a1a6-2017a4def38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1575700763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2673cb-0381-4c77-89c7-ab7be4f5a741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00a398b0f84eada178a5c1cb86e8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:01Z,use_quota=True,user_id='3f3c5a4710dd4f3f8f87b0f3e38aab7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a27aa27-eb04-44dd-943c-b71856ba9def),volume_type_id=6a27aa27-eb04-44dd-943c-b71856ba9def)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d563b3d7-2d8c-4b78-aec3-744aae6ccbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d563b3d7-2d8c-4b78-aec3-744aae6ccbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6f9edd-a438-46fc-927c-476c6744a0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:01 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6f9edd-a438-46fc-927c-476c6744a0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2673cb-0381-4c77-89c7-ab7be4f5a741', 'volume_name': 'volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fac1fa6-e14c-48f4-94e1-f9857945c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fac1fa6-e14c-48f4-94e1-f9857945c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223293c6-2c5b-4661-a6d3-78b6ee7df72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:01 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Volume fb2673cb-0381-4c77-89c7-ab7be4f5a741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741', 'volume_size': 1} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:01 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617 Apr 13 14:18:01 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:01 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.476s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Deleted volume successfully. Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acce36b3-9328-47d0-a773-2b9b286340d6 tempest-VolumesTestJSON-1642443399 None] Lock "cinder-c76fa7f9-a943-485a-870b-571471e60240-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:01 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834" returned: 0 in 0.445s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:01 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info Apr 13 14:18:01 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:01 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-759ae12f-e091-42d0-98a1-e987da927617" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-759ae12f-e091-42d0-98a1-e987da927617" released by "delete_volume" :: held 1.019s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Created reservations ['24876c12-1421-47e3-9c0f-0747c6363f44', 'e8ac7672-a260-4153-8d9f-21449ff8110c', '34d3a990-5ac7-4523-87d4-bff73dcf048f', 'c9ff356b-3e5a-445a-9e71-c62a99f5ef0f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:01 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:01 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:02 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:02 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info is being set with open permissions: ugo+rw Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:02 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info Apr 13 14:18:02 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:02 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.459s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Deleted volume successfully. Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e7a556b7-1385-4c93-9b2a-532841d7d31c tempest-VolumesActionsTest-1463682367 None] Lock "cinder-759ae12f-e091-42d0-98a1-e987da927617-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:02 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.info" returned: 0 in 0.470s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-a350c953-040b-4d39-a90c-965d777f24f1" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-a350c953-040b-4d39-a90c-965d777f24f1" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] snapshot: 1b22ca6d-9859-4802-a38f-655ef6469834, volume: a350c953-040b-4d39-a90c-965d777f24f1, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3902eac0-cb8f-4c6c-9f9e-d361e1b959cb]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:02 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 Apr 13 14:18:02 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (49d47c50-b7a0-47dd-a315-581f00c180f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9f1b47-59f7-4616-a832-ed14995d407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9f1b47-59f7-4616-a832-ed14995d407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1412336187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1996a2b6-f307-4578-ac0c-9d6318e832d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:03Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5bbfaf-180f-4372-89c1-2d08f8f151cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5bbfaf-180f-4372-89c1-2d08f8f151cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52acf627-8c75-476a-b67b-6ed91ab574f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52acf627-8c75-476a-b67b-6ed91ab574f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1996a2b6-f307-4578-ac0c-9d6318e832d2', 'volume_name': 'volume-1996a2b6-f307-4578-ac0c-9d6318e832d2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2968ab6-e1a3-4388-a1fd-35551d6cb2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2968ab6-e1a3-4388-a1fd-35551d6cb2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb5f021-daa6-4acd-9708-37599aec791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:03 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Volume 1996a2b6-f307-4578-ac0c-9d6318e832d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1996a2b6-f307-4578-ac0c-9d6318e832d2', 'volume_size': 1} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:03 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834" returned: 0 in 0.601s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df22ac-6db3-4ff4-93e5-5cdc0a4a7a6d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:03 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:18:03 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:03 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.537s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:18:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:03 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 Apr 13 14:18:03 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:05 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1" returned: 0 in 2.203s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:06 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[75809d93-42e8-4bd3-b1a2-b73bcff25b5d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:06 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:18:06 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:06 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.620s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:06 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:18:06 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Converted 1024.00 MB image at 464.41 MB/s Apr 13 14:18:06 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 is being set with open permissions: ugo+rw Apr 13 14:18:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:06 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 Apr 13 14:18:06 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:07 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1" returned: 0 in 0.489s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-a350c953-040b-4d39-a90c-965d777f24f1" released by "_copy_volume_from_snapshot" :: held 4.510s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-1b22ca6d-9859-4802-a38f-655ef6469834" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-1b22ca6d-9859-4802-a38f-655ef6469834" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Deleting offline snapshot 1b22ca6d-9859-4802-a38f-655ef6469834 of volume a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] snapshot_file for this snap is: volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0f9eac-f8d4-490c-8b9b-14c12699edc6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:07 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 Apr 13 14:18:07 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:07 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fcb9d5-9187-4b46-b2c2-3b23b6311708]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:07 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:18:07 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-39d061f4-66cd-4aa4-a975-3ece894f7059 tempest-BackendsCapabilitiesAdminTestsJSON-825649373 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82621) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 14:18:08 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.488s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:08 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 Apr 13 14:18:08 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:08 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834" returned: 0 in 0.432s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:08 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834 Apr 13 14:18:08 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1a6b9e31-5471-4b1d-8d32-72dbbe02d476 tempest-BackendsCapabilitiesAdminTestsJSON-825649373 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82621) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 14:18:08 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264.1b22ca6d-9859-4802-a38f-655ef6469834" returned: 0 in 0.418s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-1b22ca6d-9859-4802-a38f-655ef6469834" released by "_delete_snapshot" :: held 1.852s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.644s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.729s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1575700763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2673cb-0381-4c77-89c7-ab7be4f5a741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00a398b0f84eada178a5c1cb86e8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:01Z,use_quota=True,user_id='3f3c5a4710dd4f3f8f87b0f3e38aab7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a27aa27-eb04-44dd-943c-b71856ba9def),volume_type_id=6a27aa27-eb04-44dd-943c-b71856ba9def)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Creating volume fb2673cb-0381-4c77-89c7-ab7be4f5a741 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:09 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1cc0ee-e1cb-4bf2-a308-a3ffc5c48ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a350c953-040b-4d39-a90c-965d777f24f1', 'volume_size': 1, 'source_volid': 'a7b006f2-6c5f-48ed-bf9a-59d2851ab264', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d1192d-916b-46f4-9064-381507588410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:09 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 1073741824 Apr 13 14:18:09 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:09 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Volume volume-a350c953-040b-4d39-a90c-965d777f24f1 (a350c953-040b-4d39-a90c-965d777f24f1): created successfully Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d1192d-916b-46f4-9064-381507588410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Flow 'volume_create_manager' (d80fe400-de6b-4aa7-a30f-40e7b5cd58c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:09 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-99bf196a-e756-4c6b-9e1b-10e335790518 tempest-VolumeDependencyTests-293344833 None] Created volume successfully. Apr 13 14:18:09 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 1073741824" returned: 0 in 0.510s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:09 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 Apr 13 14:18:09 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-a7b006f2-6c5f-48ed-bf9a-59d2851ab264-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-a7b006f2-6c5f-48ed-bf9a-59d2851ab264-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:10 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741" returned: 0 in 0.522s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.903s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1412336187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1996a2b6-f307-4578-ac0c-9d6318e832d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:03Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Creating volume 1996a2b6-f307-4578-ac0c-9d6318e832d2 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:10 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4ce49-6251-4b1d-8c7a-3d897d7be526]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223293c6-2c5b-4661-a6d3-78b6ee7df72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6a79a0-24d5-4960-a910-04f5daccfa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:10 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 1073741824 Apr 13 14:18:10 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:10 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Volume volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 (fb2673cb-0381-4c77-89c7-ab7be4f5a741): created successfully Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6a79a0-24d5-4960-a910-04f5daccfa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Flow 'volume_create_manager' (1497e979-2f2e-4f37-a46c-0018acdb26e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:10 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-653b7a0b-ae2a-412d-bfaa-e0904a56cd8f tempest-VolumeTypesAccessTest-1852380004 None] Created volume successfully. Apr 13 14:18:10 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:18:10 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:10 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.512s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:10 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264 Apr 13 14:18:10 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:10 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 1073741824" returned: 0 in 0.604s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:10 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 Apr 13 14:18:10 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Acquiring lock "cinder-fb2673cb-0381-4c77-89c7-ab7be4f5a741-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Lock "cinder-fb2673cb-0381-4c77-89c7-ab7be4f5a741-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Acquiring lock "cinder-quobyte-fb2673cb-0381-4c77-89c7-ab7be4f5a741" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Lock "cinder-quobyte-fb2673cb-0381-4c77-89c7-ab7be4f5a741" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f9f198-6c46-4239-9b7c-d5fa54ccb34a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:10 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 Apr 13 14:18:10 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:11 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:11 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-a7b006f2-6c5f-48ed-bf9a-59d2851ab264" released by "delete_volume" :: held 1.149s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2" returned: 0 in 0.480s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb5f021-daa6-4acd-9708-37599aec791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1996a2b6-f307-4578-ac0c-9d6318e832d2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ec5db2-495e-4bc8-90a4-e63efd72ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:11 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Volume volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 (1996a2b6-f307-4578-ac0c-9d6318e832d2): created successfully Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ec5db2-495e-4bc8-90a4-e63efd72ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (49d47c50-b7a0-47dd-a315-581f00c180f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5e21e92f-5df6-4e55-aec8-403d2696bc7e tempest-VolumesActionsTest-237866144 None] Created volume successfully. Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Created reservations ['b8c0c096-44a5-4299-9f02-925770726330', '86482f6b-109f-4db3-bba5-ab00d9efce06', '3de9a8ff-eeba-48d2-826c-d996939f2313', '177bf792-4036-47ef-bb15-b43ecdd513ad'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:11 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:11 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:11 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741" returned: 0 in 0.583s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:11 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741 Apr 13 14:18:11 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-1996a2b6-f307-4578-ac0c-9d6318e832d2-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Lock "cinder-1996a2b6-f307-4578-ac0c-9d6318e832d2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-quobyte-1996a2b6-f307-4578-ac0c-9d6318e832d2" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:11 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-1996a2b6-f307-4578-ac0c-9d6318e832d2" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.543s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea6ec6-0705-4fb6-a42c-506d036548cf]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Deleted volume successfully. Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ca4a2385-a4a1-40dd-9707-2e21e62a5ab4 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-a7b006f2-6c5f-48ed-bf9a-59d2851ab264-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:11 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 Apr 13 14:18:11 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:11 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-fb2673cb-0381-4c77-89c7-ab7be4f5a741" returned: 0 in 0.547s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Lock "cinder-quobyte-fb2673cb-0381-4c77-89c7-ab7be4f5a741" released by "delete_volume" :: held 1.153s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:12 devstack cinder-volume[82621]: WARNING cinder.quota [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1219501361 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1219501361, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:12 devstack cinder-volume[82621]: WARNING cinder.quota [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1219501361 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1219501361, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Created reservations ['6759e141-d0c7-4392-a291-75ab3456b51c', 'be1ec3f6-62c2-4a92-94ee-4b5796c29609', '7c5b5af4-3379-4f9c-b430-a31ba1b35021', '7012bdf3-2f19-4700-bd46-807b8ec39c07'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:12 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:12 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-a350c953-040b-4d39-a90c-965d777f24f1-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-a350c953-040b-4d39-a90c-965d777f24f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-a350c953-040b-4d39-a90c-965d777f24f1" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-a350c953-040b-4d39-a90c-965d777f24f1" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef8514-2d55-454c-a134-40071bd810c1]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:12 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 Apr 13 14:18:12 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:12 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2" returned: 0 in 0.600s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:12 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2 Apr 13 14:18:12 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7e136c7d-67a7-419d-89e5-a31c2875bd0f tempest-GroupSnapshotsV319Test-181630918 None] Group tempest-GroupSnapshotsV319Test-Group-1114631456: creating Apr 13 14:18:12 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.479s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Deleted volume successfully. Apr 13 14:18:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7e136c7d-67a7-419d-89e5-a31c2875bd0f tempest-GroupSnapshotsV319Test-181630918 None] Group tempest-GroupSnapshotsV319Test-Group-1114631456: created successfully Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3907d3ff-932b-428f-beea-e77f602b01e2 tempest-VolumeTypesAccessTest-1852380004 None] Lock "cinder-fb2673cb-0381-4c77-89c7-ab7be4f5a741-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7e136c7d-67a7-419d-89e5-a31c2875bd0f tempest-GroupSnapshotsV319Test-181630918 None] Create group completed successfully. Apr 13 14:18:12 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:12 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1 Apr 13 14:18:12 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:12 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1996a2b6-f307-4578-ac0c-9d6318e832d2" returned: 0 in 0.473s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-1996a2b6-f307-4578-ac0c-9d6318e832d2" released by "delete_volume" :: held 1.106s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:12 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Created reservations ['d023b49c-8de2-4aa1-a33b-a1908a5836ef', '7b8910f8-1e2f-4822-97b1-4ec23572d6d8', 'f2d5ef8e-c217-4e85-b7fe-c41275cf50b3', '956db081-7319-409e-858a-0510680d928f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:13 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:13 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:13 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a350c953-040b-4d39-a90c-965d777f24f1" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-a350c953-040b-4d39-a90c-965d777f24f1" released by "delete_volume" :: held 0.974s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Created reservations ['bff56d9e-60fb-4048-a19d-a5e37fbb44f9', '929ce2f5-1d94-4106-8c23-522e07adcc77', '48e285c8-4002-4803-a47b-b0e74223ab16', '6b19a61b-d30d-4a3c-9f79-8852b1849bf9'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:13 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:13 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:13 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Deleted volume successfully. Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-420eb8bb-d210-44f3-95e6-f2a7cced9480 tempest-VolumesActionsTest-1463682367 None] Lock "cinder-1996a2b6-f307-4578-ac0c-9d6318e832d2-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:13 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.441s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Deleted volume successfully. Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5f6c1ab1-a064-4623-b09b-997db410b0e2 tempest-VolumeDependencyTests-293344833 None] Lock "cinder-a350c953-040b-4d39-a90c-965d777f24f1-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Flow 'volume_create_manager' (e372e462-d0b2-46e3-a024-545f6edc1aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f15eb4-7b2a-46cc-a734-9feed5f9c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f15eb4-7b2a-46cc-a734-9feed5f9c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-726307520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aab85454-99d8-41ea-8cb9-523ead726622,host='devstack@QuobyteHD#QuobyteHD',id=4aaf5d71-8207-4805-99ac-5d24b083e3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529e37d8363c4ffeb220b25152b5be65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:14Z,use_quota=True,user_id='6cac09cb8f7c4d07ab9ddd3c8118f5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9e3cdc3-ae2a-4e1e-bc08-0df47443af45),volume_type_id=e9e3cdc3-ae2a-4e1e-bc08-0df47443af45)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9714c07-31f3-4490-82bd-c19cfd9ec2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9714c07-31f3-4490-82bd-c19cfd9ec2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d43ce95-68ab-48f1-91ce-8beb9cf042ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d43ce95-68ab-48f1-91ce-8beb9cf042ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aaf5d71-8207-4805-99ac-5d24b083e3f0', 'volume_name': 'volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51ad9eb-5336-4dbc-a7a1-ec6a07f92a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51ad9eb-5336-4dbc-a7a1-ec6a07f92a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ade3bcb-d488-4d1c-a196-fb1c3fcd5802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Volume 4aaf5d71-8207-4805-99ac-5d24b083e3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0', 'volume_size': 1} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aab85454-99d8-41ea-8cb9-523ead726622,created_at=2026-04-13T12:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-726307520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aab85454-99d8-41ea-8cb9-523ead726622,host='devstack@QuobyteHD#QuobyteHD',id=4aaf5d71-8207-4805-99ac-5d24b083e3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529e37d8363c4ffeb220b25152b5be65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:14Z,use_quota=True,user_id='6cac09cb8f7c4d07ab9ddd3c8118f5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9e3cdc3-ae2a-4e1e-bc08-0df47443af45),volume_type_id=e9e3cdc3-ae2a-4e1e-bc08-0df47443af45)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Creating volume 4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:14 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:14 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 1073741824 Apr 13 14:18:14 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (b065a5b1-c9d2-4922-a3f0-c9b73009067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b20fdb2-3d78-4d48-9730-4c4820bfe51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b20fdb2-3d78-4d48-9730-4c4820bfe51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-52710897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8516b49f-db5f-4c15-b97f-2ba075d810c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:14Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be439f37-ce88-45fc-9e91-683a67fe7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be439f37-ce88-45fc-9e91-683a67fe7231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c1b6eb-4a23-4458-8861-7359725f3b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c1b6eb-4a23-4458-8861-7359725f3b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8516b49f-db5f-4c15-b97f-2ba075d810c5', 'volume_name': 'volume-8516b49f-db5f-4c15-b97f-2ba075d810c5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc3119b-6ed7-44d7-bd9b-6979b34d73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc3119b-6ed7-44d7-bd9b-6979b34d73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597a5c8d-d537-4114-8f97-b14218a4755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:14 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Volume 8516b49f-db5f-4c15-b97f-2ba075d810c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8516b49f-db5f-4c15-b97f-2ba075d810c5', 'volume_size': 1} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-7548ca89-1439-49e6-aa06-87b407b72cdc-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Lock "cinder-7548ca89-1439-49e6-aa06-87b407b72cdc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Acquiring lock "cinder-quobyte-7548ca89-1439-49e6-aa06-87b407b72cdc" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-7548ca89-1439-49e6-aa06-87b407b72cdc" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b475d622-a646-46e1-971a-62eac43f5e77]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:14 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc Apr 13 14:18:14 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:14 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 1073741824" returned: 0 in 0.622s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:14 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 Apr 13 14:18:14 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:15 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc" returned: 0 in 0.594s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:15 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc Apr 13 14:18:15 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:15 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-52710897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8516b49f-db5f-4c15-b97f-2ba075d810c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:14Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Creating volume 8516b49f-db5f-4c15-b97f-2ba075d810c5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:15 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ade3bcb-d488-4d1c-a196-fb1c3fcd5802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a73d60b-8559-41e4-ba9a-7101aacbb258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:15 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 1073741824 Apr 13 14:18:15 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:15 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Volume volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 (4aaf5d71-8207-4805-99ac-5d24b083e3f0): created successfully Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a73d60b-8559-41e4-ba9a-7101aacbb258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Flow 'volume_create_manager' (e372e462-d0b2-46e3-a024-545f6edc1aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2c8ec240-b2e5-48fc-bcbc-9c6321fb7019 tempest-GroupSnapshotsV319Test-181630918 None] Created volume successfully. Apr 13 14:18:15 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7548ca89-1439-49e6-aa06-87b407b72cdc" returned: 0 in 0.485s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Lock "cinder-quobyte-7548ca89-1439-49e6-aa06-87b407b72cdc" released by "delete_volume" :: held 1.112s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Created reservations ['09430bcf-4a2f-47a1-9151-7d9853f8c7a4', 'b9bea41e-36e2-4031-8141-aa2db8221323', '8965b615-6412-4f50-8bb3-f20e09c46ec3', 'fa6f13c3-0aff-4f3c-91db-df464c89bf66'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:15 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:15 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:15 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 1073741824" returned: 0 in 0.604s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:15 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 Apr 13 14:18:15 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] GroupSnapshot f13c84ea-5f67-4176-81c2-09c2923eb58c: creating. Apr 13 14:18:16 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Group snapshot f13c84ea-5f67-4176-81c2-09c2923eb58c: creating. {{(pid=82621) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.581s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Deleted volume successfully. Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fdcf7e77-67a8-4123-a1b1-34596fddb4ed tempest-VolumeDependencyTests-293344833 None] Lock "cinder-7548ca89-1439-49e6-aa06-87b407b72cdc-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:16 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5" returned: 0 in 0.537s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.093s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597a5c8d-d537-4114-8f97-b14218a4755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8516b49f-db5f-4c15-b97f-2ba075d810c5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd650cc-ee65-47ce-9ca7-686b4bd5ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:16 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Volume volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 (8516b49f-db5f-4c15-b97f-2ba075d810c5): created successfully Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd650cc-ee65-47ce-9ca7-686b4bd5ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (b065a5b1-c9d2-4922-a3f0-c9b73009067b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Creating offline snapshot f5225255-0c22-473d-b128-b44ee8817edd of volume 4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:18:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d78537f0-46f8-4f40-8b78-871f657d8bd4 tempest-VolumesActionsTest-237866144 None] Created volume successfully. Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[808ce7ae-b9c0-4239-87af-b9c5cbe2fe74]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:16 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 Apr 13 14:18:16 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Flow 'volume_create_manager' (513517bf-4099-4dff-ae14-ffc758692ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a6a838-cbce-4621-bfa0-e387c9aa30f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a6a838-cbce-4621-bfa0-e387c9aa30f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1803865129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca05b8c4-cad4-4e3d-bd98-a48935d58df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58626d867e54d5fbe7c4280494b7e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:17Z,use_quota=True,user_id='c2217d22ed0e487d91210d40759f0017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0931cd7-4ab3-4ae3-ac47-adfef4f36f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0931cd7-4ab3-4ae3-ac47-adfef4f36f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aadd3a-84a6-439c-a259-90c9999f14d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3aadd3a-84a6-439c-a259-90c9999f14d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca05b8c4-cad4-4e3d-bd98-a48935d58df1', 'volume_name': 'volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca56da3d-9e37-4215-bf1b-7ab63d2137d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca56da3d-9e37-4215-bf1b-7ab63d2137d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193a72ae-95e7-42a8-b28f-2aa995a48933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Volume ca05b8c4-cad4-4e3d-bd98-a48935d58df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1', 'volume_size': 1} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:17 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0" returned: 0 in 0.562s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:17 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd 1G Apr 13 14:18:17 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:17 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd 1G" returned: 0 in 0.546s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:17 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd Apr 13 14:18:17 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-8516b49f-db5f-4c15-b97f-2ba075d810c5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Lock "cinder-8516b49f-db5f-4c15-b97f-2ba075d810c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-quobyte-8516b49f-db5f-4c15-b97f-2ba075d810c5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-8516b49f-db5f-4c15-b97f-2ba075d810c5" acquired by "delete_volume" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f61a7-1bd8-43b5-90ae-5df395d04e1d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:17 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 Apr 13 14:18:17 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:18 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd" returned: 0 in 0.480s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:18 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:18 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd Apr 13 14:18:18 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:18 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:18 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5 Apr 13 14:18:18 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:18 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd" returned: 0 in 0.401s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:18 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info Apr 13 14:18:18 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:18 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8516b49f-db5f-4c15-b97f-2ba075d810c5" returned: 0 in 0.438s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-8516b49f-db5f-4c15-b97f-2ba075d810c5" released by "delete_volume" :: held 1.009s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Created reservations ['3249164e-fd4e-4e2f-90be-12cf0aa322b4', '3ab4dbba-2eff-46d6-b52b-5d36d8e92ca4', '1a5ea86c-b00c-4bc8-af92-5a23868490e8', '7539f5d6-a62f-4e2f-b59b-56644e8e111a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:18 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:18 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:18 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info" returned: 0 in 0.421s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:18 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 14:18:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:18 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info Apr 13 14:18:18 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:19 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.430s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Deleted volume successfully. Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ecdef7a-9523-4670-b2d7-5176aa6cfaeb tempest-VolumesActionsTest-1463682367 None] Lock "cinder-8516b49f-db5f-4c15-b97f-2ba075d810c5-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:19 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.info" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.293s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1803865129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca05b8c4-cad4-4e3d-bd98-a48935d58df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58626d867e54d5fbe7c4280494b7e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:17Z,use_quota=True,user_id='c2217d22ed0e487d91210d40759f0017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Creating volume ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:19 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:19 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 1073741824 Apr 13 14:18:19 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9a0e6aa7-4e59-4894-9671-1443b12a1d41 tempest-GroupSnapshotsV319Test-181630918 None] group_snapshot f13c84ea-5f67-4176-81c2-09c2923eb58c: created successfully Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:19 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:19 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] group_snapshot f13c84ea-5f67-4176-81c2-09c2923eb58c: deleting Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] group_snapshot f13c84ea-5f67-4176-81c2-09c2923eb58c: deleting {{(pid=82621) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "cinder-quobyte-4aaf5d71-8207-4805-99ac-5d24b083e3f0" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Lock "cinder-quobyte-4aaf5d71-8207-4805-99ac-5d24b083e3f0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "cinder-quobyte-f5225255-0c22-473d-b128-b44ee8817edd" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Lock "cinder-quobyte-f5225255-0c22-473d-b128-b44ee8817edd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Deleting offline snapshot f5225255-0c22-473d-b128-b44ee8817edd of volume 4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] snapshot_file for this snap is: volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c0ebc3-5a39-4540-8844-f4e0afcfbacc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:19 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 1073741824" returned: 0 in 0.576s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:19 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd Apr 13 14:18:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:19 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:19 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 Apr 13 14:18:19 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:20 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.528s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (489c7f2a-a461-4d2c-8a0b-ede97f6d50cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c0ee86-31fb-4611-8f8d-07476ef2ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c0ee86-31fb-4611-8f8d-07476ef2ee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077976565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08822d3d-6ffa-4948-8a08-63c05ddd4751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:20Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e0dc6d-eb98-421f-9030-1fc0ad978309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e0dc6d-eb98-421f-9030-1fc0ad978309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68d606a-f64e-4b9b-aefb-1ba84bf912c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68d606a-f64e-4b9b-aefb-1ba84bf912c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08822d3d-6ffa-4948-8a08-63c05ddd4751', 'volume_name': 'volume-08822d3d-6ffa-4948-8a08-63c05ddd4751', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f980dd3-e122-4f5c-b001-aa8d1d0046f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f980dd3-e122-4f5c-b001-aa8d1d0046f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bb8a8d-1b36-4259-b92d-2a0bb374e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:20 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Volume 08822d3d-6ffa-4948-8a08-63c05ddd4751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08822d3d-6ffa-4948-8a08-63c05ddd4751', 'volume_size': 1} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:20 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" returned: 0 in 0.446s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:20 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077976565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08822d3d-6ffa-4948-8a08-63c05ddd4751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:20Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Creating volume 08822d3d-6ffa-4948-8a08-63c05ddd4751 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:20 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd" returned: 0 in 0.575s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:18:20 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 1073741824 Apr 13 14:18:20 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193a72ae-95e7-42a8-b28f-2aa995a48933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a35cdd2-0c42-4fa7-b4d4-f17a1bb8a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fcd24d-7ec9-4ad6-b326-e5033ca23fa2]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:20 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Volume volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 (ca05b8c4-cad4-4e3d-bd98-a48935d58df1): created successfully Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a35cdd2-0c42-4fa7-b4d4-f17a1bb8a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Flow 'volume_create_manager' (513517bf-4099-4dff-ae14-ffc758692ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-efd891da-5fa4-4f32-9530-a7fb54126b92 tempest-SnapshotMetadataTestJSON-1948701215 None] Created volume successfully. Apr 13 14:18:20 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 Apr 13 14:18:20 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:20 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 1073741824" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:20 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:20 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 Apr 13 14:18:20 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:20 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd Apr 13 14:18:20 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:21 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751" returned: 0 in 0.449s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bb8a8d-1b36-4259-b92d-2a0bb374e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08822d3d-6ffa-4948-8a08-63c05ddd4751', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e7abfc-adb4-4111-8af1-8538d143c20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:21 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Volume volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 (08822d3d-6ffa-4948-8a08-63c05ddd4751): created successfully Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e7abfc-adb4-4111-8af1-8538d143c20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (489c7f2a-a461-4d2c-8a0b-ede97f6d50cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Creating offline snapshot 54cb5100-dc67-4823-bf8f-e8865edb8969 of volume ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:18:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-142e5c59-aad6-408f-8bb3-d9cb87bac87a tempest-VolumesActionsTest-237866144 None] Created volume successfully. Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca829e3-adf7-4284-9b87-45ff12f57ed4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:21 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd" returned: 0 in 0.508s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:21 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd Apr 13 14:18:21 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:21 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 Apr 13 14:18:21 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:21 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0.f5225255-0c22-473d-b128-b44ee8817edd" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Lock "cinder-quobyte-f5225255-0c22-473d-b128-b44ee8817edd" released by "_delete_snapshot" :: held 2.021s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Lock "cinder-quobyte-4aaf5d71-8207-4805-99ac-5d24b083e3f0" released by "delete_snapshot" :: held 2.041s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:21 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" returned: 0 in 0.475s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:21 devstack cinder-volume[82621]: WARNING cinder.quota [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1662801136 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1662801136, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:21 devstack cinder-volume[82621]: WARNING cinder.quota [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1662801136 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1662801136, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:21 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 1G Apr 13 14:18:21 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:21 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] Created reservations ['355543f2-7188-44a1-acb7-81422423760c', '66eed4d7-7b4e-46bf-b108-56c5fe1eabb7', 'ff3f0f7c-4b2c-40e0-b406-39f0f21653aa', 'c5e0e100-9d27-458a-ada3-423b7e19d652'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0936f675-a83e-4f0d-a384-703e91d46006 tempest-GroupSnapshotsV319Test-181630918 None] group_snapshot f13c84ea-5f67-4176-81c2-09c2923eb58c: deleted successfully Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "cinder-quobyte-4aaf5d71-8207-4805-99ac-5d24b083e3f0" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Lock "cinder-quobyte-4aaf5d71-8207-4805-99ac-5d24b083e3f0" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[847a6b9a-44ef-409b-92a2-3fd19ddf7948]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:22 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 Apr 13 14:18:22 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-08822d3d-6ffa-4948-8a08-63c05ddd4751-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Lock "cinder-08822d3d-6ffa-4948-8a08-63c05ddd4751-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Acquiring lock "cinder-quobyte-08822d3d-6ffa-4948-8a08-63c05ddd4751" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-08822d3d-6ffa-4948-8a08-63c05ddd4751" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:22 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 1G" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f689ce4-fe79-4d0d-919d-35cee9f84273]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:22 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 Apr 13 14:18:22 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:22 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 Apr 13 14:18:22 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:22 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:22 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0 Apr 13 14:18:22 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:22 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969" returned: 0 in 0.429s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:22 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 is being set with open permissions: ugo+rw Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:22 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 Apr 13 14:18:22 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:22 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751" returned: 0 in 0.512s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:22 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751 Apr 13 14:18:22 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:23 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4aaf5d71-8207-4805-99ac-5d24b083e3f0" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Lock "cinder-quobyte-4aaf5d71-8207-4805-99ac-5d24b083e3f0" released by "delete_volume" :: held 0.943s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Created reservations ['9937172b-ecc8-4b06-9d29-1eb01bc73f70'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:23 devstack cinder-volume[82621]: WARNING cinder.quota [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1662801136 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1662801136, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Created reservations ['5b657f9d-e108-4270-8f01-c5aa7f1c06ee', '66f298b4-9776-48fa-8052-d799a3601b5f', 'cc4c08bf-465b-47a9-9077-2cd6dba6b141', '3f012086-781b-4cef-9ba8-d0a0bca3fe72'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:23 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:23 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:23 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969" returned: 0 in 0.438s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:23 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info Apr 13 14:18:23 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:23 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-08822d3d-6ffa-4948-8a08-63c05ddd4751" returned: 0 in 0.427s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Lock "cinder-quobyte-08822d3d-6ffa-4948-8a08-63c05ddd4751" released by "delete_volume" :: held 0.972s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Created reservations ['24267092-3259-4e2f-83c9-eec0713816df', 'c80020e5-9734-45b0-94e0-39d30431e1d8', 'e0093b54-3bd6-4311-850a-f176553a0fa1', '112a0738-2a3a-4ddf-a801-929251a231fe'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:23 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:23 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:23 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bd38c297-299e-4c4d-ac03-4bd010d924a8 tempest-GroupSnapshotsV319Test-181630918 None] Delete group completed successfully. Apr 13 14:18:23 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info" returned: 0 in 0.419s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:23 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info is being set with open permissions: ugo+rw Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:23 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info Apr 13 14:18:23 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:23 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Deleted volume successfully. Apr 13 14:18:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d7e25f83-3911-42b8-a51a-0d99566835ef tempest-VolumesActionsTest-1463682367 None] Lock "cinder-08822d3d-6ffa-4948-8a08-63c05ddd4751-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:24 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.info" returned: 0 in 0.406s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:24 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ada70509-221f-4387-b156-1309fa8dc87a tempest-SnapshotMetadataTestJSON-1948701215 None] Create snapshot completed successfully Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (af484749-2964-4a3d-9b00-795627c26ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e18b5a9-9696-4823-98db-5d328633673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e18b5a9-9696-4823-98db-5d328633673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481301872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9240b8-32dc-4cbb-a195-88797d5f0737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:25Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5f6a62-181c-4489-957c-c1bdb468468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5f6a62-181c-4489-957c-c1bdb468468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78b0b19-d803-4efa-94fe-60a8fdbe07c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78b0b19-d803-4efa-94fe-60a8fdbe07c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9240b8-32dc-4cbb-a195-88797d5f0737', 'volume_name': 'volume-7b9240b8-32dc-4cbb-a195-88797d5f0737', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724c2c08-ddc4-487e-b0f0-89ee30bbe358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724c2c08-ddc4-487e-b0f0-89ee30bbe358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6260e7af-80e0-440b-9ee5-c70bdd449ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:24 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Volume 7b9240b8-32dc-4cbb-a195-88797d5f0737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9240b8-32dc-4cbb-a195-88797d5f0737', 'volume_size': 1} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1481301872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9240b8-32dc-4cbb-a195-88797d5f0737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58828d6f24ea41e68bcc55d5fa3c57fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:25Z,use_quota=True,user_id='ed1cc3233f6649e3b007da7e7ce9d8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Creating volume 7b9240b8-32dc-4cbb-a195-88797d5f0737 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:24 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "cinder-54cb5100-dc67-4823-bf8f-e8865edb8969-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:24 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 1073741824 Apr 13 14:18:24 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-54cb5100-dc67-4823-bf8f-e8865edb8969-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "cinder-quobyte-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-quobyte-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "cinder-quobyte-54cb5100-dc67-4823-bf8f-e8865edb8969" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-quobyte-54cb5100-dc67-4823-bf8f-e8865edb8969" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Deleting offline snapshot 54cb5100-dc67-4823-bf8f-e8865edb8969 of volume ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] snapshot_file for this snap is: volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d136b09-07b9-4c85-962b-f575606c35f2]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:25 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 Apr 13 14:18:25 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:25 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 1073741824" returned: 0 in 0.517s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:25 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 Apr 13 14:18:25 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:25 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969" returned: 0 in 0.599s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e135f-8083-4641-b16a-15320bb74875]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:25 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 Apr 13 14:18:25 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:25 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737" returned: 0 in 0.437s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6260e7af-80e0-440b-9ee5-c70bdd449ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9240b8-32dc-4cbb-a195-88797d5f0737', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04548542-36c3-405c-9bfe-971cb6ead2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:25 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Volume volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 (7b9240b8-32dc-4cbb-a195-88797d5f0737): created successfully Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04548542-36c3-405c-9bfe-971cb6ead2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:25 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Flow 'volume_create_manager' (af484749-2964-4a3d-9b00-795627c26ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d558a5cb-1810-4c21-8f58-83301764b8aa tempest-VolumesActionsTest-237866144 None] Created volume successfully. Apr 13 14:18:26 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" returned: 0 in 0.585s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:26 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 Apr 13 14:18:26 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:26 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969" returned: 0 in 0.469s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:26 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969 Apr 13 14:18:26 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:27 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1.54cb5100-dc67-4823-bf8f-e8865edb8969" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-quobyte-54cb5100-dc67-4823-bf8f-e8865edb8969" released by "_delete_snapshot" :: held 2.184s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-quobyte-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" released by "delete_snapshot" :: held 2.202s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Created reservations ['e6d4e95c-f598-4085-b28f-49d139dc1da5', '2760aa20-2888-4c88-9db9-68c82e8fdeeb', 'ff7d3759-3c86-48d3-99d9-a980ea5e6d2f', 'e5c553a9-5a2b-4ce3-a61e-b26bf025f6b9'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:27 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Delete snapshot completed successfully. Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-667f3c13-c7a0-4408-bfe8-67e2d3a84ebd tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-54cb5100-dc67-4823-bf8f-e8865edb8969-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Acquiring lock "cinder-7b9240b8-32dc-4cbb-a195-88797d5f0737-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Lock "cinder-7b9240b8-32dc-4cbb-a195-88797d5f0737-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Acquiring lock "cinder-quobyte-7b9240b8-32dc-4cbb-a195-88797d5f0737" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Lock "cinder-quobyte-7b9240b8-32dc-4cbb-a195-88797d5f0737" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[46186f08-d492-4f6d-9e13-8bde0ac07df6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:27 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 Apr 13 14:18:27 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:27 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737" returned: 0 in 0.493s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:28 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737 Apr 13 14:18:28 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "cinder-ca05b8c4-cad4-4e3d-bd98-a48935d58df1-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-ca05b8c4-cad4-4e3d-bd98-a48935d58df1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "cinder-quobyte-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-quobyte-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" acquired by "delete_volume" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97e8b17-a61b-4ece-ab40-270dd1e31362]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:28 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 Apr 13 14:18:28 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:28 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b9240b8-32dc-4cbb-a195-88797d5f0737" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Lock "cinder-quobyte-7b9240b8-32dc-4cbb-a195-88797d5f0737" released by "delete_volume" :: held 0.937s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Created reservations ['382df178-39f6-4292-b515-d165421926a7', '1a54f96c-ce1a-476d-948b-e9c3985d940e', 'a9bd0125-a0e4-4360-8ea8-fd015d414c8d', '92ff6ec5-e4c3-40e7-a0b7-b945ee842eb4'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:28 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:28 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:28 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" returned: 0 in 0.539s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:28 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1 Apr 13 14:18:28 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:28 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.458s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Deleted volume successfully. Apr 13 14:18:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1310cb0e-b268-49e2-aa20-33e7cf1b2d15 tempest-VolumesActionsTest-237866144 None] Lock "cinder-7b9240b8-32dc-4cbb-a195-88797d5f0737-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:29 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" returned: 0 in 0.570s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-quobyte-ca05b8c4-cad4-4e3d-bd98-a48935d58df1" released by "delete_volume" :: held 1.139s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Created reservations ['30935eb0-1903-4272-9d67-aba836a2f0ef', '12eb90b6-a647-4e2f-bb34-360f77cca293', 'f45e7775-8015-497c-995b-0694889d3989', 'ecbc0249-6b0f-4785-a57f-899339aebe3d'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:29 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:29 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:29 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Deleted volume successfully. Apr 13 14:18:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289a0591-1044-4272-b6fc-c4ea48460078 tempest-SnapshotMetadataTestJSON-1948701215 None] Lock "cinder-ca05b8c4-cad4-4e3d-bd98-a48935d58df1-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Flow 'volume_create_manager' (4fc49c90-e5c2-4f4d-bea1-9306e3489db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d362a7-4d5e-47df-b016-86043f282086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d362a7-4d5e-47df-b016-86043f282086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-512475738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993280d7-6e07-45cc-8efa-870f909edbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f3b92a012c4d9c87802c02457fcc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:34Z,use_quota=True,user_id='7cab6409b4ef4bb1b0270ba40bce7e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33d1ecb-b552-441f-bf63-55eea1a23cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33d1ecb-b552-441f-bf63-55eea1a23cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff5318f-075c-464c-b289-c533ed4dcd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff5318f-075c-464c-b289-c533ed4dcd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993280d7-6e07-45cc-8efa-870f909edbb2', 'volume_name': 'volume-993280d7-6e07-45cc-8efa-870f909edbb2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e2db28-e3b9-4fc5-9b5d-a4a6c8812e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e2db28-e3b9-4fc5-9b5d-a4a6c8812e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35cd971-d1e6-45ef-aa62-9f20e5ffffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Volume 993280d7-6e07-45cc-8efa-870f909edbb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993280d7-6e07-45cc-8efa-870f909edbb2', 'volume_size': 1} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-512475738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993280d7-6e07-45cc-8efa-870f909edbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f3b92a012c4d9c87802c02457fcc2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:34Z,use_quota=True,user_id='7cab6409b4ef4bb1b0270ba40bce7e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Creating volume 993280d7-6e07-45cc-8efa-870f909edbb2 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:34 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:34 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 1073741824 Apr 13 14:18:34 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Flow 'volume_create_manager' (1b56033c-a5f1-4f08-b19d-859c74abcf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d73276-0a95-462d-9e44-74fddabfe86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d73276-0a95-462d-9e44-74fddabfe86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1032312714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25aa159f-75c8-4cb9-8fd9-3084592419db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0192968103a4995845309455f8f9d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:34Z,use_quota=True,user_id='6652fc243c484cc28ff1ac07f6894ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73af2321-a43e-436f-8400-aa8948d131a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73af2321-a43e-436f-8400-aa8948d131a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e096892-4c7d-4b9d-ad4c-d65874668a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e096892-4c7d-4b9d-ad4c-d65874668a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25aa159f-75c8-4cb9-8fd9-3084592419db', 'volume_name': 'volume-25aa159f-75c8-4cb9-8fd9-3084592419db', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742fed18-74b9-4dc4-8723-2e7c9e721d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742fed18-74b9-4dc4-8723-2e7c9e721d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ec2b36-2ec7-4429-a8b3-c47163ca112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:34 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Volume 25aa159f-75c8-4cb9-8fd9-3084592419db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25aa159f-75c8-4cb9-8fd9-3084592419db', 'volume_size': 1} Apr 13 14:18:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:35 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 1073741824" returned: 0 in 0.530s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:35 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 Apr 13 14:18:35 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:35 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1032312714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25aa159f-75c8-4cb9-8fd9-3084592419db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0192968103a4995845309455f8f9d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:34Z,use_quota=True,user_id='6652fc243c484cc28ff1ac07f6894ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Creating volume 25aa159f-75c8-4cb9-8fd9-3084592419db {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:35 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35cd971-d1e6-45ef-aa62-9f20e5ffffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993280d7-6e07-45cc-8efa-870f909edbb2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:35 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db 1073741824 Apr 13 14:18:35 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72625656-21a9-4893-9ef8-80c5687d3254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:35 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Volume volume-993280d7-6e07-45cc-8efa-870f909edbb2 (993280d7-6e07-45cc-8efa-870f909edbb2): created successfully Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72625656-21a9-4893-9ef8-80c5687d3254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Flow 'volume_create_manager' (4fc49c90-e5c2-4f4d-bea1-9306e3489db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:35 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-346ca60d-4996-4ee8-9ca1-f2ddfa1f16bb tempest-VolumesMetadataTest-127624489 None] Created volume successfully. Apr 13 14:18:36 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db 1073741824" returned: 0 in 0.525s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:36 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db Apr 13 14:18:36 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:36 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=234,cinder:SELECT=176,cinder:INSERT=49,cinder:DELETE=18 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ec2b36-2ec7-4429-a8b3-c47163ca112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25aa159f-75c8-4cb9-8fd9-3084592419db', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107d5e20-7077-4f76-bb9d-55536175fc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:36 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Volume volume-25aa159f-75c8-4cb9-8fd9-3084592419db (25aa159f-75c8-4cb9-8fd9-3084592419db): created successfully Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107d5e20-7077-4f76-bb9d-55536175fc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Flow 'volume_create_manager' (1b56033c-a5f1-4f08-b19d-859c74abcf4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:36 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6a909d97-2188-4ff0-b2e6-3dd334a6ae76 tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Created volume successfully. Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Flow 'volume_create_manager' (c94f572a-013c-491e-b5c8-1e80f42d0802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5eacc7f-575e-4467-a713-a60efcc7b52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5eacc7f-575e-4467-a713-a60efcc7b52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-749890568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47278d10-8d8e-4db7-b171-82df3df3c1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8a7503e64cb3a08f1728bcca2658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:37Z,use_quota=True,user_id='9c5b812130914c49bca8033e8b2cdb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672f3713-1a93-40a6-ac1c-5961150ad57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672f3713-1a93-40a6-ac1c-5961150ad57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d79fea5-3e8f-46d1-adc1-770c40d34514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d79fea5-3e8f-46d1-adc1-770c40d34514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47278d10-8d8e-4db7-b171-82df3df3c1e7', 'volume_name': 'volume-47278d10-8d8e-4db7-b171-82df3df3c1e7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11839d92-7942-4c1f-b221-84d21d603559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11839d92-7942-4c1f-b221-84d21d603559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b226a69-2670-4bf0-ab9f-9697bf01b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:36 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Volume 47278d10-8d8e-4db7-b171-82df3df3c1e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47278d10-8d8e-4db7-b171-82df3df3c1e7', 'volume_size': 1} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-749890568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47278d10-8d8e-4db7-b171-82df3df3c1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8a7503e64cb3a08f1728bcca2658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:37Z,use_quota=True,user_id='9c5b812130914c49bca8033e8b2cdb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Creating volume 47278d10-8d8e-4db7-b171-82df3df3c1e7 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:36 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:36 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 1073741824 Apr 13 14:18:36 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Acquiring lock "cinder-993280d7-6e07-45cc-8efa-870f909edbb2-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Lock "cinder-993280d7-6e07-45cc-8efa-870f909edbb2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Acquiring lock "cinder-quobyte-993280d7-6e07-45cc-8efa-870f909edbb2" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Lock "cinder-quobyte-993280d7-6e07-45cc-8efa-870f909edbb2" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5138552-79ce-4dd2-bc31-52b8671e7aa6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:37 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 Apr 13 14:18:37 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:37 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 1073741824" returned: 0 in 0.517s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:37 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 Apr 13 14:18:37 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:37 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2" returned: 0 in 0.506s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:37 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2 Apr 13 14:18:37 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:37 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7" returned: 0 in 0.456s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b226a69-2670-4bf0-ab9f-9697bf01b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47278d10-8d8e-4db7-b171-82df3df3c1e7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72446b6b-edfc-4d62-844f-a3412865e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:37 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Volume volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 (47278d10-8d8e-4db7-b171-82df3df3c1e7): created successfully Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72446b6b-edfc-4d62-844f-a3412865e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:37 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Flow 'volume_create_manager' (c94f572a-013c-491e-b5c8-1e80f42d0802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:37 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f7ac4d38-888f-4abe-8775-52e78f3a0c02 tempest-VolumesListAdminTestJSON-856845604 None] Created volume successfully. Apr 13 14:18:38 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-993280d7-6e07-45cc-8efa-870f909edbb2" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Lock "cinder-quobyte-993280d7-6e07-45cc-8efa-870f909edbb2" released by "delete_volume" :: held 0.976s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Created reservations ['8d648d53-6ec2-4a40-9c9d-52fdd2e3ae55', '09e4933f-6abf-4a75-8795-78440022e00a', 'fbc345b9-145a-4fc2-8901-841e14b69f89', '08af61aa-ef11-46be-8e69-e3ebfb89a9d6'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:38 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:38 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Acquiring lock "cinder-25aa159f-75c8-4cb9-8fd9-3084592419db-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "cinder-25aa159f-75c8-4cb9-8fd9-3084592419db-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Acquiring lock "cinder-quobyte-25aa159f-75c8-4cb9-8fd9-3084592419db" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "cinder-quobyte-25aa159f-75c8-4cb9-8fd9-3084592419db" acquired by "delete_volume" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b773a2b-30be-4106-9fab-a324fde9cfd6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:38 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db Apr 13 14:18:38 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:38 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.483s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:38 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Deleted volume successfully. Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e1c20d72-6714-43be-8d25-520173392bc2 tempest-VolumesMetadataTest-127624489 None] Lock "cinder-993280d7-6e07-45cc-8efa-870f909edbb2-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:38 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db" returned: 0 in 0.584s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:38 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db Apr 13 14:18:38 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=243,cinder:SELECT=191,cinder:INSERT=65,cinder:DELETE=17 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Flow 'volume_create_manager' (abf8e771-cab5-44f7-93fa-c6112a6359ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e7cab-804e-469f-9863-b281b108e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:39 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e7cab-804e-469f-9863-b281b108e86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1639103629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb98df6-a863-4ae6-a4e8-715e947b2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8a7503e64cb3a08f1728bcca2658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:39Z,use_quota=True,user_id='9c5b812130914c49bca8033e8b2cdb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f86eaa-fa0a-4fc5-a96d-b549ddfd526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f86eaa-fa0a-4fc5-a96d-b549ddfd526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb8e81b-a420-46ee-90e4-4a47598fc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb8e81b-a420-46ee-90e4-4a47598fc262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb98df6-a863-4ae6-a4e8-715e947b2581', 'volume_name': 'volume-4bb98df6-a863-4ae6-a4e8-715e947b2581', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc8775-e676-4495-8099-802b59d959bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc8775-e676-4495-8099-802b59d959bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d379a2d5-6cee-4d6c-91ff-852c6371a20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Volume 4bb98df6-a863-4ae6-a4e8-715e947b2581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb98df6-a863-4ae6-a4e8-715e947b2581', 'volume_size': 1} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1639103629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb98df6-a863-4ae6-a4e8-715e947b2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8a7503e64cb3a08f1728bcca2658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:39Z,use_quota=True,user_id='9c5b812130914c49bca8033e8b2cdb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Creating volume 4bb98df6-a863-4ae6-a4e8-715e947b2581 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:39 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-25aa159f-75c8-4cb9-8fd9-3084592419db" returned: 0 in 0.529s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "cinder-quobyte-25aa159f-75c8-4cb9-8fd9-3084592419db" released by "delete_volume" :: held 1.136s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:39 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 1073741824 Apr 13 14:18:39 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Created reservations ['b5e06fd4-3610-4466-9b3d-2137c374ad0e', '1da35694-69ab-4292-b970-f2846d1183ba', 'c70883bc-e595-4d7b-81af-b064a1dc93a3', '10ee849d-bd91-436b-abbb-f4ce32aa1859'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:39 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:39 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:39 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 1073741824" returned: 0 in 0.550s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:39 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Deleted volume successfully. Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3081e086-777f-4b31-a2cb-bfbba9b63b2f tempest-VolumeQuotasNegativeTestJSON-1237380651 None] Lock "cinder-25aa159f-75c8-4cb9-8fd9-3084592419db-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:40 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 Apr 13 14:18:40 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:40 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d379a2d5-6cee-4d6c-91ff-852c6371a20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb98df6-a863-4ae6-a4e8-715e947b2581', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc44050-f8eb-4cd4-95ff-cac1794347a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Volume volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 (4bb98df6-a863-4ae6-a4e8-715e947b2581): created successfully Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc44050-f8eb-4cd4-95ff-cac1794347a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Flow 'volume_create_manager' (abf8e771-cab5-44f7-93fa-c6112a6359ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2a1b6bf1-eca6-4361-9546-68723f9735f9 tempest-VolumesListAdminTestJSON-856845604 None] Created volume successfully. Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Flow 'volume_create_manager' (5a94bd16-3fab-435a-82d4-cb04fa623ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c033e6ef-4ac5-46c5-80a9-7a345c3358de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c033e6ef-4ac5-46c5-80a9-7a345c3358de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-119538423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f790cbc3-2655-4fc2-bd7a-1c32f0934b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd966bb5672f42e8bfd49b9435046300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:41Z,use_quota=True,user_id='8d8eac78db1d40d69bb8a3e100485f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac6f21f-8b50-48ca-b8df-a08325958ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac6f21f-8b50-48ca-b8df-a08325958ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b96f48-9eae-4a2b-96d4-1f76d65d0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b96f48-9eae-4a2b-96d4-1f76d65d0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f790cbc3-2655-4fc2-bd7a-1c32f0934b30', 'volume_name': 'volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffc3a90-e000-4203-bdc4-06ba78348c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffc3a90-e000-4203-bdc4-06ba78348c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac8e7a7-341e-4389-8b6d-72afd9837ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Volume f790cbc3-2655-4fc2-bd7a-1c32f0934b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30', 'volume_size': 1} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-119538423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f790cbc3-2655-4fc2-bd7a-1c32f0934b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd966bb5672f42e8bfd49b9435046300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:41Z,use_quota=True,user_id='8d8eac78db1d40d69bb8a3e100485f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Creating volume f790cbc3-2655-4fc2-bd7a-1c32f0934b30 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:40 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:40 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 1073741824 Apr 13 14:18:40 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:41 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 1073741824" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:41 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 Apr 13 14:18:41 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Flow 'volume_create_manager' (281f443d-0792-48cf-9cfe-70b878ce086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650ff82e-e889-448f-b7f2-957221d2a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650ff82e-e889-448f-b7f2-957221d2a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1227001172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235c738-63f4-489f-8eee-0d868ef3ce4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8a7503e64cb3a08f1728bcca2658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:42Z,use_quota=True,user_id='9c5b812130914c49bca8033e8b2cdb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be11ee45-b181-46b4-95d1-40bb878457ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be11ee45-b181-46b4-95d1-40bb878457ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04d0676-3a98-42c9-a193-40aabb3efd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04d0676-3a98-42c9-a193-40aabb3efd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1235c738-63f4-489f-8eee-0d868ef3ce4e', 'volume_name': 'volume-1235c738-63f4-489f-8eee-0d868ef3ce4e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49719a35-af36-4c22-94f0-ccf9e2fb96e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49719a35-af36-4c22-94f0-ccf9e2fb96e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2b1ae3-541c-49e1-86a1-7d1247df2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:41 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Volume 1235c738-63f4-489f-8eee-0d868ef3ce4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1235c738-63f4-489f-8eee-0d868ef3ce4e', 'volume_size': 1} Apr 13 14:18:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:42 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30" returned: 0 in 0.559s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.168s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1227001172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235c738-63f4-489f-8eee-0d868ef3ce4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e8a7503e64cb3a08f1728bcca2658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:42Z,use_quota=True,user_id='9c5b812130914c49bca8033e8b2cdb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Creating volume 1235c738-63f4-489f-8eee-0d868ef3ce4e {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:42 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac8e7a7-341e-4389-8b6d-72afd9837ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073aa04-5ffe-45e6-9136-b7d8aa2368ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:42 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e 1073741824 Apr 13 14:18:42 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Volume volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 (f790cbc3-2655-4fc2-bd7a-1c32f0934b30): created successfully Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073aa04-5ffe-45e6-9136-b7d8aa2368ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Flow 'volume_create_manager' (5a94bd16-3fab-435a-82d4-cb04fa623ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-26d4e33e-26b8-4b18-9311-2ceea6b2938e tempest-VolumesTransfersV355Test-350779891 None] Created volume successfully. Apr 13 14:18:42 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e 1073741824" returned: 0 in 0.543s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:42 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e Apr 13 14:18:42 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:43 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2b1ae3-541c-49e1-86a1-7d1247df2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1235c738-63f4-489f-8eee-0d868ef3ce4e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1febff0f-dbed-4507-af07-34495ac0917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:43 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Volume volume-1235c738-63f4-489f-8eee-0d868ef3ce4e (1235c738-63f4-489f-8eee-0d868ef3ce4e): created successfully Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1febff0f-dbed-4507-af07-34495ac0917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Flow 'volume_create_manager' (281f443d-0792-48cf-9cfe-70b878ce086a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-33ea635e-36a7-44dd-8fa4-dc463bda2d4f tempest-VolumesListAdminTestJSON-856845604 None] Created volume successfully. Apr 13 14:18:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bcf52920-aec6-4de1-8da1-bc5b272bdc41 tempest-VolumesTransfersV355Test-1626242387 None] Transfer volume completed successfully. Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Flow 'volume_create_manager' (97a5696a-7072-420b-aad4-00173eeffab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d05166-b910-4ff5-80e5-a170f753b1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d05166-b910-4ff5-80e5-a170f753b1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1844618266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ea6fc7-3325-4755-b9a3-79a07e6b9312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b241c27638f46afab7e4f973e44174b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:44Z,use_quota=True,user_id='9dfabc422b6d46ec8bb1e63602833039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcedd8c1-6021-496d-be15-008d7f6088cf),volume_type_id=dcedd8c1-6021-496d-be15-008d7f6088cf)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8f195e-c82d-47b1-8a0c-18df96c775f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8f195e-c82d-47b1-8a0c-18df96c775f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955d341e-ffa8-4ce6-a314-edb1d90ed241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955d341e-ffa8-4ce6-a314-edb1d90ed241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ea6fc7-3325-4755-b9a3-79a07e6b9312', 'volume_name': 'volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb27c3d-7457-466d-9db9-c36c3c3948a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb27c3d-7457-466d-9db9-c36c3c3948a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e8918e-4cfe-4f84-a7f4-8f24b2cecbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:43 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Volume 10ea6fc7-3325-4755-b9a3-79a07e6b9312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312', 'volume_size': 1} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1844618266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ea6fc7-3325-4755-b9a3-79a07e6b9312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b241c27638f46afab7e4f973e44174b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:44Z,use_quota=True,user_id='9dfabc422b6d46ec8bb1e63602833039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcedd8c1-6021-496d-be15-008d7f6088cf),volume_type_id=dcedd8c1-6021-496d-be15-008d7f6088cf)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Creating volume 10ea6fc7-3325-4755-b9a3-79a07e6b9312 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:43 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:43 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 1073741824 Apr 13 14:18:43 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:44 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Flow 'volume_create_manager' (a6fcf245-381a-453c-afa9-76a2fe2c2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c174711-2172-41d6-980b-969a0bd7910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 1073741824" returned: 0 in 0.608s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c174711-2172-41d6-980b-969a0bd7910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef043f99-3174-41d9-8615-018159263a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c68ff10d4c74d6198e7f6fd87224e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:44Z,use_quota=True,user_id='2c8b7e2f91754255bf56169ec551ee03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc52e110-8636-47f9-adbb-3dc6c446f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc52e110-8636-47f9-adbb-3dc6c446f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5558754c-a025-4ca9-ad3e-3b74655bdcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5558754c-a025-4ca9-ad3e-3b74655bdcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef043f99-3174-41d9-8615-018159263a5f', 'volume_name': 'volume-ef043f99-3174-41d9-8615-018159263a5f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7661d6-8983-40c3-8270-36bda2a98704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7661d6-8983-40c3-8270-36bda2a98704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fccca4-d57d-4b60-a3f4-2a06c0eb4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Volume ef043f99-3174-41d9-8615-018159263a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef043f99-3174-41d9-8615-018159263a5f', 'volume_size': 1} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Acquiring lock "cinder-f790cbc3-2655-4fc2-bd7a-1c32f0934b30-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-f790cbc3-2655-4fc2-bd7a-1c32f0934b30-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Acquiring lock "cinder-quobyte-f790cbc3-2655-4fc2-bd7a-1c32f0934b30" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-quobyte-f790cbc3-2655-4fc2-bd7a-1c32f0934b30" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:44 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 Apr 13 14:18:44 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efb126a-4939-44d4-a6a6-6e7009cbd085]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:44 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 Apr 13 14:18:44 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:44 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312" returned: 0 in 0.409s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef043f99-3174-41d9-8615-018159263a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c68ff10d4c74d6198e7f6fd87224e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:44Z,use_quota=True,user_id='2c8b7e2f91754255bf56169ec551ee03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Creating volume ef043f99-3174-41d9-8615-018159263a5f {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:44 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e8918e-4cfe-4f84-a7f4-8f24b2cecbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fb067b-b372-4865-97a6-89924c1cea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:44 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f 1073741824 Apr 13 14:18:44 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Volume volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 (10ea6fc7-3325-4755-b9a3-79a07e6b9312): created successfully Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fb067b-b372-4865-97a6-89924c1cea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Flow 'volume_create_manager' (97a5696a-7072-420b-aad4-00173eeffab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e15a7a00-4dc8-4efa-84d1-42b9b646237b tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Created volume successfully. Apr 13 14:18:44 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:44 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30 Apr 13 14:18:44 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:45 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f 1073741824" returned: 0 in 0.458s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:45 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f Apr 13 14:18:45 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:45 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f790cbc3-2655-4fc2-bd7a-1c32f0934b30" returned: 0 in 0.443s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-quobyte-f790cbc3-2655-4fc2-bd7a-1c32f0934b30" released by "delete_volume" :: held 0.963s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Created reservations ['d4da0cd2-6cc1-4f6d-a963-655d72f7744e', 'e0f5cb3c-7ba8-420b-8e55-5fadc39f8ad8', 'c2f8fa14-140f-40aa-b7b0-40f730388077', '2e1e0bd5-ca48-446a-a796-3f8cf644ca25'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:45 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:45 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:45 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fccca4-d57d-4b60-a3f4-2a06c0eb4e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef043f99-3174-41d9-8615-018159263a5f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c402201-723b-43ca-88f3-31301a9f2b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:45 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Volume volume-ef043f99-3174-41d9-8615-018159263a5f (ef043f99-3174-41d9-8615-018159263a5f): created successfully Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c402201-723b-43ca-88f3-31301a9f2b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Flow 'volume_create_manager' (a6fcf245-381a-453c-afa9-76a2fe2c2629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f592b37d-6b05-47ac-a731-533b9bbdeee4 tempest-VolumesListAdminTestJSON-1333745726 None] Created volume successfully. Apr 13 14:18:45 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.427s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Deleted volume successfully. Apr 13 14:18:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b32436f9-5956-41b6-aded-541125f5c97f tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-f790cbc3-2655-4fc2-bd7a-1c32f0934b30-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:46 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:46 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:46 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.411s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d825506a-896d-47a0-b81d-9c3ef4131927 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Retype volume completed successfully. Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Acquiring lock "cinder-ef043f99-3174-41d9-8615-018159263a5f-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Lock "cinder-ef043f99-3174-41d9-8615-018159263a5f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Acquiring lock "cinder-quobyte-ef043f99-3174-41d9-8615-018159263a5f" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Lock "cinder-quobyte-ef043f99-3174-41d9-8615-018159263a5f" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d967e9d-9f50-4231-9422-22eb97fe6b05]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "cinder-1235c738-63f4-489f-8eee-0d868ef3ce4e-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-1235c738-63f4-489f-8eee-0d868ef3ce4e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "cinder-quobyte-1235c738-63f4-489f-8eee-0d868ef3ce4e" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-quobyte-1235c738-63f4-489f-8eee-0d868ef3ce4e" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc29088-1b13-4c85-819b-e221b5fb2597]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:46 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f Apr 13 14:18:46 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:46 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e Apr 13 14:18:46 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Flow 'volume_create_manager' (7fea942d-8eeb-44f5-af16-b56a9f93e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da876035-c920-4697-a587-48839a641603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da876035-c920-4697-a587-48839a641603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-982347477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1843413-8d9d-431d-98d4-ae086f0e4682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd966bb5672f42e8bfd49b9435046300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:47Z,use_quota=True,user_id='8d8eac78db1d40d69bb8a3e100485f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3754fe19-c387-4df7-822f-c75a383acd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3754fe19-c387-4df7-822f-c75a383acd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4716ed05-2ed3-4985-83aa-741a006f00e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4716ed05-2ed3-4985-83aa-741a006f00e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1843413-8d9d-431d-98d4-ae086f0e4682', 'volume_name': 'volume-d1843413-8d9d-431d-98d4-ae086f0e4682', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d88391-fd9d-46e1-94d6-ec15331d1466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d88391-fd9d-46e1-94d6-ec15331d1466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789c2083-2a2e-4c9a-977b-5e8a7191b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:46 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Volume d1843413-8d9d-431d-98d4-ae086f0e4682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1843413-8d9d-431d-98d4-ae086f0e4682', 'volume_size': 1} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-982347477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1843413-8d9d-431d-98d4-ae086f0e4682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd966bb5672f42e8bfd49b9435046300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:47Z,use_quota=True,user_id='8d8eac78db1d40d69bb8a3e100485f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Creating volume d1843413-8d9d-431d-98d4-ae086f0e4682 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:46 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:46 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 1073741824 Apr 13 14:18:46 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f Apr 13 14:18:47 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e Apr 13 14:18:47 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Acquiring lock "cinder-10ea6fc7-3325-4755-b9a3-79a07e6b9312-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "cinder-10ea6fc7-3325-4755-b9a3-79a07e6b9312-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Acquiring lock "cinder-quobyte-10ea6fc7-3325-4755-b9a3-79a07e6b9312" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "cinder-quobyte-10ea6fc7-3325-4755-b9a3-79a07e6b9312" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a390c-bd15-43da-b297-be96ba0439cf]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 Apr 13 14:18:47 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 1073741824" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 Apr 13 14:18:47 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ef043f99-3174-41d9-8615-018159263a5f" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Lock "cinder-quobyte-ef043f99-3174-41d9-8615-018159263a5f" released by "delete_volume" :: held 0.985s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Created reservations ['70a9d68d-c93d-485d-8b9d-833168248b02', '201fb1c2-30c3-43ce-8133-edd8c97f0dda', 'a483e668-66c7-4480-99f5-e7b27f704aa7', 'd11b6256-9247-43b6-b181-62b3c10232dd'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:47 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1235c738-63f4-489f-8eee-0d868ef3ce4e" returned: 0 in 0.498s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-quobyte-1235c738-63f4-489f-8eee-0d868ef3ce4e" released by "delete_volume" :: held 1.086s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Created reservations ['bff86efb-e066-4232-b51a-96fd4f4395f6', '12703afb-a139-49e6-9948-927999d46454', '1e883a57-6ee1-4983-9b91-9970a45e37ac', '6a6a2f8e-a562-4531-94d5-61366cd12978'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:47 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312" returned: 0 in 0.518s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:47 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312 Apr 13 14:18:47 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:47 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789c2083-2a2e-4c9a-977b-5e8a7191b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1843413-8d9d-431d-98d4-ae086f0e4682', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f6b91d-dd2b-4a5a-acb0-01a425f457a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:47 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Volume volume-d1843413-8d9d-431d-98d4-ae086f0e4682 (d1843413-8d9d-431d-98d4-ae086f0e4682): created successfully Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f6b91d-dd2b-4a5a-acb0-01a425f457a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Flow 'volume_create_manager' (7fea942d-8eeb-44f5-af16-b56a9f93e71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a0142e45-04f9-4671-aed9-0a8db4b07792 tempest-VolumesTransfersV355Test-350779891 None] Created volume successfully. Apr 13 14:18:48 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Deleted volume successfully. Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-9b273b9b-e347-47f3-b550-984cf7acc86b tempest-VolumesListAdminTestJSON-1333745726 None] Lock "cinder-ef043f99-3174-41d9-8615-018159263a5f-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:48 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Deleted volume successfully. Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c171f3a4-15e6-42b1-b08d-2d350877a8b9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-1235c738-63f4-489f-8eee-0d868ef3ce4e-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:48 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-10ea6fc7-3325-4755-b9a3-79a07e6b9312" returned: 0 in 0.414s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "cinder-quobyte-10ea6fc7-3325-4755-b9a3-79a07e6b9312" released by "delete_volume" :: held 0.953s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:48 devstack cinder-volume[82621]: WARNING cinder.quota [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:48 devstack cinder-volume[82621]: WARNING cinder.quota [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Created reservations ['dab8fd51-9c65-4773-ade7-a331c3542652', 'ff245fe3-b361-4731-bab7-bf0b9ae66f5a', '6757e0b2-9a26-4b32-8246-1a922b73fda0', '0d6b906e-0d15-4693-a94d-30c83db85df3'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:48 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:48 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:48 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Deleted volume successfully. Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-81a6a22e-1132-42b3-9e93-409601cd3c98 tempest-VolumeRetypeWithoutMigrationTest-1558606960 None] Lock "cinder-10ea6fc7-3325-4755-b9a3-79a07e6b9312-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "cinder-4bb98df6-a863-4ae6-a4e8-715e947b2581-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-4bb98df6-a863-4ae6-a4e8-715e947b2581-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "cinder-quobyte-4bb98df6-a863-4ae6-a4e8-715e947b2581" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-quobyte-4bb98df6-a863-4ae6-a4e8-715e947b2581" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e63b939-9fe5-405a-afe3-1790f81dd409]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:48 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 Apr 13 14:18:48 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Acquiring lock "cinder-d1843413-8d9d-431d-98d4-ae086f0e4682-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-d1843413-8d9d-431d-98d4-ae086f0e4682-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Acquiring lock "cinder-quobyte-d1843413-8d9d-431d-98d4-ae086f0e4682" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-quobyte-d1843413-8d9d-431d-98d4-ae086f0e4682" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a35a8f4-5365-43b8-9c1c-d7e33740afbc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:49 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 Apr 13 14:18:49 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:49 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581" returned: 0 in 0.512s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:49 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581 Apr 13 14:18:49 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:49 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682" returned: 0 in 0.559s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:49 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682 Apr 13 14:18:49 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:49 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4bb98df6-a863-4ae6-a4e8-715e947b2581" returned: 0 in 0.472s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-quobyte-4bb98df6-a863-4ae6-a4e8-715e947b2581" released by "delete_volume" :: held 1.007s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Created reservations ['deb295f6-76e9-41bf-82de-35009685d9f2', '60533fc5-f53b-4450-838a-7ebf93d88d88', '0c288bc0-a76d-41e6-bd57-b65652691935', '19decb53-5b03-4cc6-aee5-d3f07f238dac'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:49 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:49 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:50 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d1843413-8d9d-431d-98d4-ae086f0e4682" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-quobyte-d1843413-8d9d-431d-98d4-ae086f0e4682" released by "delete_volume" :: held 1.056s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Created reservations ['15e35855-3723-421b-b19f-df76ba109c92', '0725e5ca-1169-4e0c-927a-fe821d1ef38b', '9a469c39-d770-49e0-a2b3-139e69c0b2d0', 'e705a68c-d18c-4b35-92ec-dabc4863874f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:50 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:50 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:50 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Deleted volume successfully. Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd225d98-641f-415e-b419-2b637c953cc9 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-4bb98df6-a863-4ae6-a4e8-715e947b2581-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:50 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.456s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Deleted volume successfully. Apr 13 14:18:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb3cba2b-f9a7-49c0-bdae-dee4bed14ea2 tempest-VolumesTransfersV355Test-525112061 None] Lock "cinder-d1843413-8d9d-431d-98d4-ae086f0e4682-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "cinder-47278d10-8d8e-4db7-b171-82df3df3c1e7-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-47278d10-8d8e-4db7-b171-82df3df3c1e7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "cinder-quobyte-47278d10-8d8e-4db7-b171-82df3df3c1e7" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-quobyte-47278d10-8d8e-4db7-b171-82df3df3c1e7" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[72992db1-f796-4706-adc1-a8383364a8f3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:51 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 Apr 13 14:18:51 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:51 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7" returned: 0 in 0.542s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:51 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7 Apr 13 14:18:51 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:52 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-47278d10-8d8e-4db7-b171-82df3df3c1e7" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-quobyte-47278d10-8d8e-4db7-b171-82df3df3c1e7" released by "delete_volume" :: held 1.044s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Created reservations ['60a7eb9f-94a9-4e95-b443-b3478d927560', 'f661ad42-d925-4994-89df-22444375f0da', 'c90310e4-0d19-443b-ad74-a2c6cbca5127', '5cc5a7d9-b898-4b45-a0ff-992f4c3675bb'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:52 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:18:52 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:52 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:18:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Deleted volume successfully. Apr 13 14:18:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5fb70bc-5904-4ddb-ba55-58941b7ac272 tempest-VolumesListAdminTestJSON-856845604 None] Lock "cinder-47278d10-8d8e-4db7-b171-82df3df3c1e7-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Flow 'volume_create_manager' (7e48c76c-3200-4ba2-afdd-b145bf3eba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2412bf31-9d0b-4bfc-8a9d-61b6c6ad77d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2412bf31-9d0b-4bfc-8a9d-61b6c6ad77d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1874109721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f588e4-ffbc-4058-accc-48ecbb1c8e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cbcbfab2074576b8c1a906c45ecc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:53Z,use_quota=True,user_id='5451ac37d0e34de6b260a30cabee063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7323578-5791-42ae-a96c-cff1b5b071a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7323578-5791-42ae-a96c-cff1b5b071a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce5b25e-20f9-450a-9dac-1aab5a09931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce5b25e-20f9-450a-9dac-1aab5a09931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f588e4-ffbc-4058-accc-48ecbb1c8e0f', 'volume_name': 'volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249c818e-62ac-4b22-b848-f322bbf054cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249c818e-62ac-4b22-b848-f322bbf054cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642ca944-0f71-443d-9d20-290d8a574a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:53 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Volume 86f588e4-ffbc-4058-accc-48ecbb1c8e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f', 'volume_size': 1} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1874109721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f588e4-ffbc-4058-accc-48ecbb1c8e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cbcbfab2074576b8c1a906c45ecc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:53Z,use_quota=True,user_id='5451ac37d0e34de6b260a30cabee063a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Creating volume 86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:53 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:53 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f 1073741824 Apr 13 14:18:53 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:53 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f 1073741824" returned: 0 in 0.581s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:53 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f Apr 13 14:18:53 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:54 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" returned: 0 in 0.566s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642ca944-0f71-443d-9d20-290d8a574a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e4db30-8354-4084-bad5-384c8f9f1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:54 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Volume volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f (86f588e4-ffbc-4058-accc-48ecbb1c8e0f): created successfully Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e4db30-8354-4084-bad5-384c8f9f1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:54 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Flow 'volume_create_manager' (7e48c76c-3200-4ba2-afdd-b145bf3eba66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:54 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6a7cf147-56fd-46af-82de-b1e1a91dab17 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Created volume successfully. Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Flow 'volume_create_manager' (81e50ecf-fd62-4239-9984-43636d201e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b645f0-7a9d-44a3-8b36-b67f09af286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b645f0-7a9d-44a3-8b36-b67f09af286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1413429233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8614096b-a358-4c5f-b867-c6c769a76d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6cc2a488144b50907adc8a7986b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:55Z,use_quota=True,user_id='c0fc48f6dd3c4f159a313ced81fd1178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49639b96-0fe6-4927-bcaa-936663ea142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49639b96-0fe6-4927-bcaa-936663ea142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a25473-17fc-473b-9a4f-f50fe094a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.image.glance [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Creating Keystone auth plugin from conf {{(pid=82621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a25473-17fc-473b-9a4f-f50fe094a535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8614096b-a358-4c5f-b867-c6c769a76d2f', 'volume_name': 'volume-8614096b-a358-4c5f-b867-c6c769a76d2f', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8f37f5-8c00-49e4-b714-ae709131e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8f37f5-8c00-49e4-b714-ae709131e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22336442-7722-4157-acc6-dd3bbcd63b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:55 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Volume 8614096b-a358-4c5f-b867-c6c769a76d2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8614096b-a358-4c5f-b867-c6c769a76d2f', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Trying to clone 8614096b-a358-4c5f-b867-c6c769a76d2f from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]). {{(pid=82621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Creating offline snapshot c572d620-8458-4d0b-a96b-ebce7f5c08c4 of volume 86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a9233f-3c27-4dd0-a17b-b50511f5f1a0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 14:18:55 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Image download 20.69 MB at 20.69 MB/s Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1385e-6718-4743-a5fd-efc65b43d13d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:55 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f Apr 13 14:18:55 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:55 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD Apr 13 14:18:55 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:56 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" returned: 0 in 0.529s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:56 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 1G Apr 13 14:18:56 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:56 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD" returned: 0 in 0.561s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 is fetched for user c0fc48f6dd3c4f159a313ced81fd1178. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffd996-2014-4fd3-8e3f-e4344efdf486]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:56 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD Apr 13 14:18:56 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:56 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 1G" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:56 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 Apr 13 14:18:56 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:56 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD" returned: 0 in 0.546s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:57 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:57 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 is being set with open permissions: ugo+rw Apr 13 14:18:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:57 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 Apr 13 14:18:57 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:57 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:57 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info Apr 13 14:18:57 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:57 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info" returned: 0 in 0.419s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:57 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info is being set with open permissions: ugo+rw Apr 13 14:18:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:57 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info Apr 13 14:18:57 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:58 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.info" returned: 0 in 0.436s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1413429233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8614096b-a358-4c5f-b867-c6c769a76d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6cc2a488144b50907adc8a7986b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:55Z,use_quota=True,user_id='c0fc48f6dd3c4f159a313ced81fd1178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Creating volume 8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:58 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:58 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 1073741824 Apr 13 14:18:58 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6eb8ecea-65e2-4651-af15-6c9ffb14274f tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Create snapshot completed successfully Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Flow 'volume_create_manager' (fbb95940-ec33-48bb-acd1-afd019ea6a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96cccdd-8440-4161-ad87-2fde3b682543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96cccdd-8440-4161-ad87-2fde3b682543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-231113820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f6bde4-22e2-4247-91c1-04f01d639e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3bacf7ea7a488ebb2f9ee4aac3bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:59Z,use_quota=True,user_id='59a5b317c73344058b040a2e185e40c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2286dc62-ffe9-4ffe-8d95-8640717ed8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2286dc62-ffe9-4ffe-8d95-8640717ed8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9c6941-4f93-4c50-b11a-e664fa47da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9c6941-4f93-4c50-b11a-e664fa47da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f6bde4-22e2-4247-91c1-04f01d639e88', 'volume_name': 'volume-61f6bde4-22e2-4247-91c1-04f01d639e88', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88dfda2-f94a-4e9c-b01c-83a8f951d3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88dfda2-f94a-4e9c-b01c-83a8f951d3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280dff43-6468-40a9-bdbf-adf71d3198f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:18:58 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Volume 61f6bde4-22e2-4247-91c1-04f01d639e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f6bde4-22e2-4247-91c1-04f01d639e88', 'volume_size': 1} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "cinder-c572d620-8458-4d0b-a96b-ebce7f5c08c4-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-c572d620-8458-4d0b-a96b-ebce7f5c08c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "cinder-quobyte-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-quobyte-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "cinder-quobyte-c572d620-8458-4d0b-a96b-ebce7f5c08c4" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-quobyte-c572d620-8458-4d0b-a96b-ebce7f5c08c4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Deleting offline snapshot c572d620-8458-4d0b-a96b-ebce7f5c08c4 of volume 86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] snapshot_file for this snap is: volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[617136ee-d8db-4546-a762-e67c387ee1e3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:58 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 Apr 13 14:18:58 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:59 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 1073741824" returned: 0 in 0.605s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:59 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:18:59 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:59 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:59 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4" returned: 0 in 0.518s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa25c09-0973-4c21-b136-ebeec1671299]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-231113820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f6bde4-22e2-4247-91c1-04f01d639e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3bacf7ea7a488ebb2f9ee4aac3bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:18:59Z,use_quota=True,user_id='59a5b317c73344058b040a2e185e40c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Creating volume 61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:18:59 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:59 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 1073741824 Apr 13 14:18:59 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Attempting download of c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume 8614096b-a358-4c5f-b867-c6c769a76d2f. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[916eca08-2a0e-4bc5-bca3-6f8480b52b49]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:59 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f Apr 13 14:18:59 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:59 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd Apr 13 14:18:59 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:18:59 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 1073741824" returned: 0 in 0.496s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:18:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:18:59 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" returned: 0 in 0.523s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:00 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:00 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:00 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 Apr 13 14:19:00 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:00 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd" returned: 0 in 0.531s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:00 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd Apr 13 14:19:00 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:00 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280dff43-6468-40a9-bdbf-adf71d3198f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f6bde4-22e2-4247-91c1-04f01d639e88', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eaf664-3372-4711-b030-55ad4602271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:00 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Volume volume-61f6bde4-22e2-4247-91c1-04f01d639e88 (61f6bde4-22e2-4247-91c1-04f01d639e88): created successfully Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eaf664-3372-4711-b030-55ad4602271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Flow 'volume_create_manager' (fbb95940-ec33-48bb-acd1-afd019ea6a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:00 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-48258be0-bdaa-4470-bfc5-3d167dd8246d tempest-VolumesCloneTest-1556042619 None] Created volume successfully. Apr 13 14:19:00 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4" returned: 0 in 0.485s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:00 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4 Apr 13 14:19:00 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:00 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd" returned: 1 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_p5z7j7vd' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d11aea-7a6f-40af-831a-71779346a130]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:00 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD Apr 13 14:19:00 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:00 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f.c572d620-8458-4d0b-a96b-ebce7f5c08c4" returned: 0 in 0.417s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-quobyte-c572d620-8458-4d0b-a96b-ebce7f5c08c4" released by "_delete_snapshot" :: held 2.031s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-quobyte-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" released by "delete_snapshot" :: held 2.046s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:00 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Created reservations ['cbd24825-8b9b-4d8f-b286-37e425a7659a', '45dc6e85-6528-4258-bb32-b87ac8bf8ae0', 'abc737f5-a01b-4b26-8a70-cce06ebfe168', '3898766e-bd44-4f9c-acd6-1cc5caf58633'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:01 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] c223e7fa-335f-4690-8d1c-349d8cc0aad3 was qcow2, converting to raw {{(pid=82621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:01 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:01 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Delete snapshot completed successfully. Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4585a6eb-c8b3-4faf-a2ee-3d973fe4ce41 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-c572d620-8458-4d0b-a96b-ebce7f5c08c4-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Flow 'volume_create_manager' (60b6705e-a0a3-4d62-857d-bc6654c1ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b866d93-e1ef-4725-a45d-c7b0b71a24f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b866d93-e1ef-4725-a45d-c7b0b71a24f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-940541569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc466005-f57c-4ab6-aa0e-516d5ba66f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3bacf7ea7a488ebb2f9ee4aac3bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=61f6bde4-22e2-4247-91c1-04f01d639e88,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:01Z,use_quota=True,user_id='59a5b317c73344058b040a2e185e40c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74bb09f-85a5-498b-8a8a-ceb38fb9120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74bb09f-85a5-498b-8a8a-ceb38fb9120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d295de0a-c691-4d44-a762-9b7d368997f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d295de0a-c691-4d44-a762-9b7d368997f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cc466005-f57c-4ab6-aa0e-516d5ba66f5b', 'volume_name': 'volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b', 'volume_size': 2, 'source_volid': '61f6bde4-22e2-4247-91c1-04f01d639e88', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b015bc36-6ce4-4090-9cc8-f14aec7066db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b015bc36-6ce4-4090-9cc8-f14aec7066db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08def622-5183-41ab-adcd-44ac4d94fb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:01 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Volume cc466005-f57c-4ab6-aa0e-516d5ba66f5b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b', 'volume_size': 2, 'source_volid': '61f6bde4-22e2-4247-91c1-04f01d639e88', 'source_volstatus': 'available'} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:01 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Cloning volume 61f6bde4-22e2-4247-91c1-04f01d639e88 to volume cc466005-f57c-4ab6-aa0e-516d5ba66f5b Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Creating offline snapshot 6a51ba1f-d03e-45ec-a38b-47d5503c25fb of volume 61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fa3b5c-a049-4094-ba45-7227e79c52b9]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:01 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:01 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:01 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.543s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:01 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb 1G Apr 13 14:19:01 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:01 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 0 in 0.835s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_4l__alz3devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:19:01 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Converted 112.00 MB image at 112.00 MB/s Apr 13 14:19:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:01 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 1G Apr 13 14:19:01 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "cinder-86f588e4-ffbc-4058-accc-48ecbb1c8e0f-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-86f588e4-ffbc-4058-accc-48ecbb1c8e0f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "cinder-quobyte-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-quobyte-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ed550-2cb9-4d9d-80e6-852b6cb5966a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:02 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f Apr 13 14:19:02 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:02 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb 1G" returned: 0 in 0.534s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f6bde4-22e2-4247-91c1-04f01d639e88 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:02 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f6bde4-22e2-4247-91c1-04f01d639e88 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb Apr 13 14:19:02 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:02 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 1G" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cde15d-0032-4f07-8831-2924b2786e63]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:02 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:02 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:02 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" returned: 0 in 0.513s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:02 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f Apr 13 14:19:02 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:02 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f6bde4-22e2-4247-91c1-04f01d639e88 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb" returned: 0 in 0.442s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:02 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb is being set with open permissions: ugo+rw Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:02 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb Apr 13 14:19:02 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:02 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:02 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:02 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:03 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" returned: 0 in 0.405s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-quobyte-86f588e4-ffbc-4058-accc-48ecbb1c8e0f" released by "delete_volume" :: held 0.947s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Created reservations ['aa89dca4-cbef-46f3-bc51-ff7357fbc28a', 'ff48703a-7441-4083-a0a2-d3c93cd58132', '97881192-9bc1-442e-8020-a3d644a488e0', 'cdb1dbd6-1a40-45ef-8612-194caf77f781'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:03 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb" returned: 0 in 0.470s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:03 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:03 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:03 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info Apr 13 14:19:03 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:03 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 1 in 0.524s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Downloaded image c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume 8614096b-a358-4c5f-b867-c6c769a76d2f successfully. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 for user c0fc48f6dd3c4f159a313ced81fd1178 is deleted. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Marking volume 8614096b-a358-4c5f-b867-c6c769a76d2f as bootable. {{(pid=82621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Copying metadata from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 to 8614096b-a358-4c5f-b867-c6c769a76d2f. {{(pid=82621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Creating volume glance metadata for volume 8614096b-a358-4c5f-b867-c6c769a76d2f backed by image c223e7fa-335f-4690-8d1c-349d8cc0aad3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22336442-7722-4157-acc6-dd3bbcd63b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8614096b-a358-4c5f-b867-c6c769a76d2f', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c6f8c-b788-4812-8135-8b796a107dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:03 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Volume volume-8614096b-a358-4c5f-b867-c6c769a76d2f (8614096b-a358-4c5f-b867-c6c769a76d2f): created successfully Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c6f8c-b788-4812-8135-8b796a107dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Flow 'volume_create_manager' (81e50ecf-fd62-4239-9984-43636d201e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:03 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-23eaad77-3963-4b3b-9daa-ecdd7f95ee26 tempest-VolumesExtendTest-1948834690 None] Created volume successfully. Apr 13 14:19:03 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.392s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:03 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Deleted volume successfully. Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-27c8affb-3527-4eec-b3e9-75af6a01b599 tempest-VolumeSnapshotQuotasNegativeTestJSON-588097486 None] Lock "cinder-86f588e4-ffbc-4058-accc-48ecbb1c8e0f-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:03 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info" returned: 0 in 0.420s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:03 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info is being set with open permissions: ugo+rw Apr 13 14:19:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:03 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info Apr 13 14:19:03 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:04 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.info" returned: 0 in 0.398s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Acquiring lock "cinder-quobyte-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] snapshot: 6a51ba1f-d03e-45ec-a38b-47d5503c25fb, volume: cc466005-f57c-4ab6-aa0e-516d5ba66f5b, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2609289c-1a4e-42ca-92db-4fd62afa373f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:04 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb Apr 13 14:19:04 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:04 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f6bde4-22e2-4247-91c1-04f01d639e88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd6a7d-25e0-4379-ae36-c84ddf7832da]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:04 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:04 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:05 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:05 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:19:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:05 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b Apr 13 14:19:05 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:07 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" returned: 0 in 2.089s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc86d234-871a-44ab-b84c-8af2cf73603b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:07 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:07 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:07 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.657s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:07 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:19:07 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Converted 1024.00 MB image at 489.83 MB/s Apr 13 14:19:07 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b is being set with open permissions: ugo+rw Apr 13 14:19:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:07 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b Apr 13 14:19:07 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:08 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" released by "_copy_volume_from_snapshot" :: held 4.314s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Acquiring lock "cinder-quobyte-6a51ba1f-d03e-45ec-a38b-47d5503c25fb" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-6a51ba1f-d03e-45ec-a38b-47d5503c25fb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Deleting offline snapshot 6a51ba1f-d03e-45ec-a38b-47d5503c25fb of volume 61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] snapshot_file for this snap is: volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[67947401-5132-42a0-9d17-2749e73486c6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:08 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb Apr 13 14:19:08 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:08 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb" returned: 0 in 0.535s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f6bde4-22e2-4247-91c1-04f01d639e88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8659f113-9b08-4361-b16b-91d4481ee01e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:09 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:09 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:09 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.538s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:09 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb Apr 13 14:19:09 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:09 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb" returned: 0 in 0.488s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:10 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb Apr 13 14:19:10 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:10 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88.6a51ba1f-d03e-45ec-a38b-47d5503c25fb" returned: 0 in 0.469s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-6a51ba1f-d03e-45ec-a38b-47d5503c25fb" released by "_delete_snapshot" :: held 2.078s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.320s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.912s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08def622-5183-41ab-adcd-44ac4d94fb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b', 'volume_size': 2, 'source_volid': '61f6bde4-22e2-4247-91c1-04f01d639e88', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7dedf90-45f7-4fea-bba3-c86522aa1270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:10 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Volume volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b (cc466005-f57c-4ab6-aa0e-516d5ba66f5b): created successfully Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7dedf90-45f7-4fea-bba3-c86522aa1270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Flow 'volume_create_manager' (60b6705e-a0a3-4d62-857d-bc6654c1ec35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe57349e-5a78-4ec8-a853-93ae5f205470]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:10 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-dcef97be-82b6-4e34-8b2d-45d9895720df tempest-VolumesCloneTest-1556042619 None] Created volume successfully. Apr 13 14:19:10 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:10 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Acquiring lock "cinder-cc466005-f57c-4ab6-aa0e-516d5ba66f5b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Lock "cinder-cc466005-f57c-4ab6-aa0e-516d5ba66f5b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Acquiring lock "cinder-quobyte-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd726e-ec3d-49c6-a88b-e3b6754bf2da]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:10 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b Apr 13 14:19:10 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Flow 'volume_create_manager' (4613ba4e-1f65-4f6b-9a5c-bfeb83b60f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:11 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cd9759-5187-4d04-b76c-582042320fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 0 in 0.538s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cd9759-5187-4d04-b76c-582042320fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-416702770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38c7e9d-f084-457c-b0d6-02f940ebecae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80593d480860454aa6f2f9e99c25b972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:11Z,use_quota=True,user_id='c91a458d36d84814b49e718a821abc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f08608c-3716-446b-9df7-39f4f44e2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f08608c-3716-446b-9df7-39f4f44e2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8ef37e-0f87-4940-a46a-b069b6e5bdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8ef37e-0f87-4940-a46a-b069b6e5bdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38c7e9d-f084-457c-b0d6-02f940ebecae', 'volume_name': 'volume-b38c7e9d-f084-457c-b0d6-02f940ebecae', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2127ff-36b5-4638-a23d-b9379518c600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2127ff-36b5-4638-a23d-b9379518c600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd6d477-98b2-45a1-a0f2-76c6f274d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:11 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Volume b38c7e9d-f084-457c-b0d6-02f940ebecae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38c7e9d-f084-457c-b0d6-02f940ebecae', 'volume_size': 1} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:11 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:11 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:11 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:11 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b Apr 13 14:19:11 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:11 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 1 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 2G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f 2G" returned: 0 in 0.041s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.070s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-416702770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38c7e9d-f084-457c-b0d6-02f940ebecae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80593d480860454aa6f2f9e99c25b972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:11Z,use_quota=True,user_id='c91a458d36d84814b49e718a821abc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Creating volume b38c7e9d-f084-457c-b0d6-02f940ebecae {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:11 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:11 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae 1073741824 Apr 13 14:19:11 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8f65e288-90fd-4423-8cae-ac6860d8b771 tempest-VolumesExtendTest-1948834690 None] Extend volume completed successfully. Apr 13 14:19:11 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" returned: 0 in 0.419s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-cc466005-f57c-4ab6-aa0e-516d5ba66f5b" released by "delete_volume" :: held 0.934s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Created reservations ['5cdfee64-d66a-442e-9175-3f14028ee56f', '4906f36f-8de6-49f1-aab1-2c7efcb643bf', '3a92d9a6-8252-4ea5-8c56-7353b3fda304', '78dd9c1c-ba7a-48d2-ba96-6a02edfe5e30'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:11 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:11 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Acquiring lock "cinder-61f6bde4-22e2-4247-91c1-04f01d639e88-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Lock "cinder-61f6bde4-22e2-4247-91c1-04f01d639e88-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Acquiring lock "cinder-quobyte-61f6bde4-22e2-4247-91c1-04f01d639e88" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-61f6bde4-22e2-4247-91c1-04f01d639e88" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2079f-2a34-4499-8a0b-bb3834a92976]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:12 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae 1073741824" returned: 0 in 0.561s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:12 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:12 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:12 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae Apr 13 14:19:12 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:12 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.501s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Deleted volume successfully. Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-8012a6f9-57bc-449b-a196-c47fc8e6d7cc tempest-VolumesCloneTest-1556042619 None] Lock "cinder-cc466005-f57c-4ab6-aa0e-516d5ba66f5b-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-8614096b-a358-4c5f-b867-c6c769a76d2f-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-8614096b-a358-4c5f-b867-c6c769a76d2f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-quobyte-8614096b-a358-4c5f-b867-c6c769a76d2f" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-8614096b-a358-4c5f-b867-c6c769a76d2f" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3926efb7-59b0-481d-8393-bd1e312cc3c9]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:12 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:12 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:12 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.506s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:12 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88 Apr 13 14:19:12 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:12 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd6d477-98b2-45a1-a0f2-76c6f274d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38c7e9d-f084-457c-b0d6-02f940ebecae', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e93da3-ce56-4a49-b00c-09149f1063b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:12 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Volume volume-b38c7e9d-f084-457c-b0d6-02f940ebecae (b38c7e9d-f084-457c-b0d6-02f940ebecae): created successfully Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e93da3-ce56-4a49-b00c-09149f1063b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Flow 'volume_create_manager' (4613ba4e-1f65-4f6b-9a5c-bfeb83b60f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6f79fee3-0236-489e-9d59-9fb731a6c5c7 tempest-AbsoluteLimitsTests-1155454822 None] Created volume successfully. Apr 13 14:19:12 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 0 in 0.490s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:13 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:13 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:13 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-61f6bde4-22e2-4247-91c1-04f01d639e88" returned: 0 in 0.449s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Lock "cinder-quobyte-61f6bde4-22e2-4247-91c1-04f01d639e88" released by "delete_volume" :: held 1.003s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Created reservations ['d2104b78-38f4-4273-84a6-1e31675e8eae', '395290a8-b6b2-4c5a-a699-febc04a02406', 'eca3ee96-ed98-4e61-b397-50fdca1862e4', 'b0ec2c2c-a0dc-4d6a-a9ef-91a98dd1e174'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:13 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:13 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Acquiring lock "cinder-b38c7e9d-f084-457c-b0d6-02f940ebecae-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Lock "cinder-b38c7e9d-f084-457c-b0d6-02f940ebecae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Acquiring lock "cinder-quobyte-b38c7e9d-f084-457c-b0d6-02f940ebecae" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Lock "cinder-quobyte-b38c7e9d-f084-457c-b0d6-02f940ebecae" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b59924f-fe24-4408-b4b9-d825bcd45f49]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:13 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae Apr 13 14:19:13 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:13 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 1 in 0.610s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:13 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f Apr 13 14:19:13 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:13 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.497s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Deleted volume successfully. Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-626f5f1f-c727-44ea-b1b8-0aefec8e67c5 tempest-VolumesCloneTest-1556042619 None] Lock "cinder-61f6bde4-22e2-4247-91c1-04f01d639e88-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:13 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae" returned: 0 in 0.600s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:13 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae Apr 13 14:19:13 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:14 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8614096b-a358-4c5f-b867-c6c769a76d2f" returned: 0 in 0.528s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-8614096b-a358-4c5f-b867-c6c769a76d2f" released by "delete_volume" :: held 1.667s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Created reservations ['6c4c19bc-06c5-446a-b43e-8b3ed8ec5606', 'f14e3a63-7ebf-4608-8c37-591bd2a78ea9', 'b107b36d-ad28-4d49-8f12-d26abb279f4d', '6aa47264-1aea-478a-b940-d15c34f7ac05'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:14 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:14 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:14 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b38c7e9d-f084-457c-b0d6-02f940ebecae" returned: 0 in 0.508s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Lock "cinder-quobyte-b38c7e9d-f084-457c-b0d6-02f940ebecae" released by "delete_volume" :: held 1.129s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Created reservations ['eaaf3abb-670b-46a7-8e40-bea361eb31e9', 'a89e3100-b563-4e11-b275-6de9c2a4218c', '238bc88c-3c76-4506-ac78-21584e7530ac', '19320fb1-ba21-4339-9fed-2cb606a3bfb0'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:14 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:14 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:14 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.470s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:14 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Deleted volume successfully. Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1aa0ac4f-3d36-40a1-acfe-53b5de30d3b2 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-8614096b-a358-4c5f-b867-c6c769a76d2f-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Flow 'volume_create_manager' (682a496a-0e9f-49a5-8b79-ae60bc2ec069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8bcb72-83ce-4a5e-821c-06589a2e4116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8bcb72-83ce-4a5e-821c-06589a2e4116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1660098661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a67ebb-316c-4d61-bb56-e291125d2e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6cc2a488144b50907adc8a7986b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:15Z,use_quota=True,user_id='c0fc48f6dd3c4f159a313ced81fd1178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fec07bb-16b0-4a11-a6ad-9f1033fe66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fec07bb-16b0-4a11-a6ad-9f1033fe66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da7e66c-d0ca-4e3b-aa80-a563b3879024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da7e66c-d0ca-4e3b-aa80-a563b3879024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a67ebb-316c-4d61-bb56-e291125d2e24', 'volume_name': 'volume-20a67ebb-316c-4d61-bb56-e291125d2e24', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b18d5b-56d4-474f-98d4-f40a1bbfb05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b18d5b-56d4-474f-98d4-f40a1bbfb05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7353555f-d073-4782-9fb7-08a26c08a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:14 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Volume 20a67ebb-316c-4d61-bb56-e291125d2e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a67ebb-316c-4d61-bb56-e291125d2e24', 'volume_size': 1} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1660098661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a67ebb-316c-4d61-bb56-e291125d2e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6cc2a488144b50907adc8a7986b354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:15Z,use_quota=True,user_id='c0fc48f6dd3c4f159a313ced81fd1178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Creating volume 20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:14 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:14 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 1073741824 Apr 13 14:19:14 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:15 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (a81e9ccf-2ff1-4218-806c-c86e41a8a47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37722a99-b554-451a-b5eb-5689811b602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.504s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Deleted volume successfully. Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37722a99-b554-451a-b5eb-5689811b602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1939927431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f579defe-0c7f-41cf-be81-459cbd087b46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:15Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aeea303-375f-4ed7-a59b-851fe0b4b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aeea303-375f-4ed7-a59b-851fe0b4b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7425df-7b87-480e-99cf-7ae67e12a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7425df-7b87-480e-99cf-7ae67e12a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f579defe-0c7f-41cf-be81-459cbd087b46', 'volume_name': 'volume-f579defe-0c7f-41cf-be81-459cbd087b46', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a04555-cb9e-4177-b7bd-9b11c377c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a04555-cb9e-4177-b7bd-9b11c377c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f5455a-7e30-406e-88f0-ac1ac4294f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:15 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Volume f579defe-0c7f-41cf-be81-459cbd087b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f579defe-0c7f-41cf-be81-459cbd087b46', 'volume_size': 1} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ec721122-cec8-4781-ae16-d92ee622a97b tempest-AbsoluteLimitsTests-1155454822 None] Lock "cinder-b38c7e9d-f084-457c-b0d6-02f940ebecae-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:15 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 1073741824" returned: 0 in 0.510s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:15 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 Apr 13 14:19:15 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:15 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1939927431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f579defe-0c7f-41cf-be81-459cbd087b46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:15Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Creating volume f579defe-0c7f-41cf-be81-459cbd087b46 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:15 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7353555f-d073-4782-9fb7-08a26c08a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a67ebb-316c-4d61-bb56-e291125d2e24', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:15 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 1073741824 Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781ec81a-f5a3-4332-9135-7fa95a723666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:15 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:15 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Volume volume-20a67ebb-316c-4d61-bb56-e291125d2e24 (20a67ebb-316c-4d61-bb56-e291125d2e24): created successfully Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781ec81a-f5a3-4332-9135-7fa95a723666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Flow 'volume_create_manager' (682a496a-0e9f-49a5-8b79-ae60bc2ec069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-01778266-a9db-4bfb-bcc2-de6a4a216753 tempest-VolumesExtendTest-1948834690 None] Created volume successfully. Apr 13 14:19:16 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 1073741824" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:16 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 Apr 13 14:19:16 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:16 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f5455a-7e30-406e-88f0-ac1ac4294f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f579defe-0c7f-41cf-be81-459cbd087b46', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4cc00e-57ea-459f-82bc-db6377d6d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:16 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Volume volume-f579defe-0c7f-41cf-be81-459cbd087b46 (f579defe-0c7f-41cf-be81-459cbd087b46): created successfully Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4cc00e-57ea-459f-82bc-db6377d6d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (a81e9ccf-2ff1-4218-806c-c86e41a8a47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c007c917-676b-4c81-a969-dc6f596c8a4c tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Creating offline snapshot 0974c708-f523-4efe-ac02-cd6484769d07 of volume 20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc927527-23f7-4953-9516-0f51f604680f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:17 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 Apr 13 14:19:17 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (e241f463-cd66-4093-86d1-f6fde86eac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d56b8b-4a7a-42cd-8f0d-1032763de031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d56b8b-4a7a-42cd-8f0d-1032763de031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-420517080',display_name='tempest-VolumesGetTest-Volume-66709107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f219a089-43a3-42c4-83d6-6856bb4accc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:18Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ed8eff-a1cc-427f-9759-11778e32517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ed8eff-a1cc-427f-9759-11778e32517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c71970-3f6f-42e1-9cb0-33500d3edd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c71970-3f6f-42e1-9cb0-33500d3edd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f219a089-43a3-42c4-83d6-6856bb4accc5', 'volume_name': 'volume-f219a089-43a3-42c4-83d6-6856bb4accc5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60314302-8b8a-47d6-a85b-ff3d5a0701f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60314302-8b8a-47d6-a85b-ff3d5a0701f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4fd705-1e89-496b-aa92-3260ab5365f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Volume f219a089-43a3-42c4-83d6-6856bb4accc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f219a089-43a3-42c4-83d6-6856bb4accc5', 'volume_size': 1} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:17 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24" returned: 0 in 0.576s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:17 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 1G Apr 13 14:19:17 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Flow 'volume_create_manager' (8fc28b6d-d9e4-4e7f-b6b9-810e62228bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342a0a70-8115-4246-b853-54bfa869c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342a0a70-8115-4246-b853-54bfa869c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533354798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ae7897-4a91-4325-b1ee-d68ca0f0c755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90727327c4db457481eec1b48fe3fb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:18Z,use_quota=True,user_id='1dfc2e27f9b241b79fd54a4867b3d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a55baa-339d-466b-84f4-905972717472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a55baa-339d-466b-84f4-905972717472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd71aed9-0598-4313-bcb2-f97769131eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd71aed9-0598-4313-bcb2-f97769131eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ae7897-4a91-4325-b1ee-d68ca0f0c755', 'volume_name': 'volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0bed06-5415-4ded-9eea-11f66e786d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0bed06-5415-4ded-9eea-11f66e786d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13983973-b7d0-4c58-9cf9-665ad5098375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Volume 53ae7897-4a91-4325-b1ee-d68ca0f0c755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755', 'volume_size': 1} Apr 13 14:19:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:18 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 1G" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a67ebb-316c-4d61-bb56-e291125d2e24 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:18 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a67ebb-316c-4d61-bb56-e291125d2e24 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 Apr 13 14:19:18 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:18 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a67ebb-316c-4d61-bb56-e291125d2e24 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07" returned: 0 in 0.416s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:18 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 is being set with open permissions: ugo+rw Apr 13 14:19:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:18 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 Apr 13 14:19:18 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:19 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07" returned: 0 in 0.409s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:19 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info Apr 13 14:19:19 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:19 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info" returned: 0 in 0.387s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:19 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info is being set with open permissions: ugo+rw Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:19 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info Apr 13 14:19:19 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:19 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:19 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:19 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.info" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-420517080',display_name='tempest-VolumesGetTest-Volume-66709107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f219a089-43a3-42c4-83d6-6856bb4accc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:18Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Creating volume f219a089-43a3-42c4-83d6-6856bb4accc5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:19 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:19 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 1073741824 Apr 13 14:19:19 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4020ea22-0e11-44e2-b230-efe15aadef12 tempest-VolumesExtendTest-1948834690 None] Create snapshot completed successfully Apr 13 14:19:19 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:20 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 1073741824" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:20 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 Apr 13 14:19:20 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:20 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5" returned: 0 in 0.400s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.785s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1533354798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ae7897-4a91-4325-b1ee-d68ca0f0c755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90727327c4db457481eec1b48fe3fb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:18Z,use_quota=True,user_id='1dfc2e27f9b241b79fd54a4867b3d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Creating volume 53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:20 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4fd705-1e89-496b-aa92-3260ab5365f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f219a089-43a3-42c4-83d6-6856bb4accc5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:20 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 1073741824 Apr 13 14:19:20 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72ef1b2-d80c-4f45-9a78-296115182d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:20 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Volume volume-f219a089-43a3-42c4-83d6-6856bb4accc5 (f219a089-43a3-42c4-83d6-6856bb4accc5): created successfully Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72ef1b2-d80c-4f45-9a78-296115182d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (e241f463-cd66-4093-86d1-f6fde86eac0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3745062c-1cfb-4526-826a-bb948a22c4f8 tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:21 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 1073741824" returned: 0 in 0.454s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:21 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 Apr 13 14:19:21 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:21 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755" returned: 0 in 0.389s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.374s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cae50a-0206-44db-92d4-78c7f014838d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13983973-b7d0-4c58-9cf9-665ad5098375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca04ce7e-43cb-4c9c-95c5-d6645a064c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:21 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Volume volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 (53ae7897-4a91-4325-b1ee-d68ca0f0c755): created successfully Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca04ce7e-43cb-4c9c-95c5-d6645a064c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Flow 'volume_create_manager' (8fc28b6d-d9e4-4e7f-b6b9-810e62228bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-44a553cb-6cf2-4250-8e6c-975ce79a9be5 tempest-VolumesDeleteCascade-412500601 None] Created volume successfully. Apr 13 14:19:21 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 Apr 13 14:19:21 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-f219a089-43a3-42c4-83d6-6856bb4accc5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Lock "cinder-f219a089-43a3-42c4-83d6-6856bb4accc5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-f219a089-43a3-42c4-83d6-6856bb4accc5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-f219a089-43a3-42c4-83d6-6856bb4accc5" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f095a0-9645-49a7-a431-1be1f75c4ac8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:22 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 Apr 13 14:19:22 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:22 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24" returned: 0 in 0.545s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 2G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 2G" returned: 0 in 0.056s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.616s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.029s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Creating offline snapshot cfe8b39f-f286-407c-8191-231ec5962521 of volume 53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fe89fc-0bf3-4e99-9c4c-19e995da8e9d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-84549c7a-c6bc-48a4-8f7a-97d2f858a4e0 tempest-VolumesExtendTest-1948834690 None] Extend volume completed successfully. Apr 13 14:19:22 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 Apr 13 14:19:22 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-0974c708-f523-4efe-ac02-cd6484769d07-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Lock "cinder-0974c708-f523-4efe-ac02-cd6484769d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-quobyte-20a67ebb-316c-4d61-bb56-e291125d2e24" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:22 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-20a67ebb-316c-4d61-bb56-e291125d2e24" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-quobyte-0974c708-f523-4efe-ac02-cd6484769d07" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5" returned: 0 in 0.563s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-0974c708-f523-4efe-ac02-cd6484769d07" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Deleting offline snapshot 0974c708-f523-4efe-ac02-cd6484769d07 of volume 20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] snapshot_file for this snap is: volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:22 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5 Apr 13 14:19:22 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b6d56-8370-4fd7-95c8-1c70e611db4d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:22 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 Apr 13 14:19:22 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:22 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:22 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 1G Apr 13 14:19:22 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:22 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f219a089-43a3-42c4-83d6-6856bb4accc5" returned: 0 in 0.431s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-f219a089-43a3-42c4-83d6-6856bb4accc5" released by "delete_volume" :: held 1.028s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:22 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Created reservations ['61b9c6ae-a89c-4f5b-9e52-8bfb42122e4e', 'e20612b0-ab6d-4c99-a0e3-cf1efb483f64', '61c02b1d-6313-4f34-a584-63ea671df1eb', '4abfa7f1-bbb6-461f-b595-c368eb1ad926'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:23 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a67ebb-316c-4d61-bb56-e291125d2e24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:23 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:23 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ffb66-c54e-45f8-92dd-23c2659c9298]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:23 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 Apr 13 14:19:23 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:23 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 1G" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:23 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:23 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:23 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.406s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-96ea95d4-0218-4b12-b819-15c0c5c691a4 tempest-VolumesGetTest-1835127947 None] Lock "cinder-f219a089-43a3-42c4-83d6-6856bb4accc5-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:23 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24" returned: 0 in 0.483s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:23 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 Apr 13 14:19:23 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:23 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.426s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:23 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 is being set with open permissions: ugo+rw Apr 13 14:19:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:23 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:23 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:24 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07" returned: 0 in 0.480s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:24 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07 Apr 13 14:19:24 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-f579defe-0c7f-41cf-be81-459cbd087b46-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Lock "cinder-f579defe-0c7f-41cf-be81-459cbd087b46-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:24 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-f579defe-0c7f-41cf-be81-459cbd087b46" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-f579defe-0c7f-41cf-be81-459cbd087b46" acquired by "delete_volume" :: waited 0.031s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:24 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info Apr 13 14:19:24 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[14affbfa-f249-4bf8-9ab2-cec4ceca0cb0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:24 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 Apr 13 14:19:24 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:24 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24.0974c708-f523-4efe-ac02-cd6484769d07" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-0974c708-f523-4efe-ac02-cd6484769d07" released by "_delete_snapshot" :: held 1.957s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-20a67ebb-316c-4d61-bb56-e291125d2e24" released by "delete_snapshot" :: held 1.981s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Created reservations ['92335fac-61c5-4bc3-a64f-cd14f2181ab5', '207fcf1b-56b4-492c-8d1c-c87f85388d31', 'a7375298-ca20-48bd-8067-660dfade99a3', 'b6e51ae9-ce59-4976-8450-b2d27688b32f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:24 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Delete snapshot completed successfully. Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b4509b2-b3de-4327-9e88-1bb844f8dd4d tempest-VolumesExtendTest-1948834690 None] Lock "cinder-0974c708-f523-4efe-ac02-cd6484769d07-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:24 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info" returned: 0 in 0.420s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:24 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info is being set with open permissions: ugo+rw Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:24 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info Apr 13 14:19:24 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-20a67ebb-316c-4d61-bb56-e291125d2e24-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-20a67ebb-316c-4d61-bb56-e291125d2e24-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "cinder-quobyte-20a67ebb-316c-4d61-bb56-e291125d2e24" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-20a67ebb-316c-4d61-bb56-e291125d2e24" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9e5182-8ec9-4cf9-b2fa-d339738325b9]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:24 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46" returned: 0 in 0.538s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:24 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46 Apr 13 14:19:24 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:24 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 Apr 13 14:19:24 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:25 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.info" returned: 0 in 0.420s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3bf8d52a-023c-4930-a282-ba431dc58ce2 tempest-VolumesDeleteCascade-412500601 None] Create snapshot completed successfully Apr 13 14:19:25 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f579defe-0c7f-41cf-be81-459cbd087b46" returned: 0 in 0.418s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-f579defe-0c7f-41cf-be81-459cbd087b46" released by "delete_volume" :: held 0.983s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Created reservations ['4c92f740-429b-45c2-bbe0-eb0580f46ebf', 'aad36e0c-7fc7-48bf-a6a2-f067d47a4c3e', 'c7047746-6a4f-4d3b-9cea-07f419b2535b', 'b8ba04aa-93d5-42e1-9f33-3bcd6e6ef5b2'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:25 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24" returned: 0 in 0.497s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:25 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24 Apr 13 14:19:25 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:25 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:25 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Creating offline snapshot 3a710705-ca82-4bca-ae20-0b7a6e755eaf of volume 53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b7a6f7-caa7-498b-8ba7-fec4a946ace8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:25 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:25 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:25 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-20a67ebb-316c-4d61-bb56-e291125d2e24" returned: 0 in 0.433s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-quobyte-20a67ebb-316c-4d61-bb56-e291125d2e24" released by "delete_volume" :: held 0.966s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Created reservations ['7981147e-ed7f-4acb-a0d4-c24b3f302f41', '0ff81701-211f-41de-ae38-d29b59548e94', '9442218c-ac69-4826-b8d1-1689a5872b4b', 'a878dca8-f138-44e7-9d7f-f76424660d9b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:25 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.463s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:19:25 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:25 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6e9e3989-b138-4376-a0bd-6d27b8edb87c tempest-VolumesGetTest-1835127947 None] Lock "cinder-f579defe-0c7f-41cf-be81-459cbd087b46-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:25 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.533s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:26 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf 1G Apr 13 14:19:26 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:26 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.468s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:26 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Deleted volume successfully. Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0a360ca-7c43-420e-8f2f-812940e30269 tempest-VolumesExtendTest-1948834690 None] Lock "cinder-20a67ebb-316c-4d61-bb56-e291125d2e24-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (0b387544-cbab-41bc-8ea6-f6a85713e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b155c5-c02f-41d6-ae0f-28dce272a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b155c5-c02f-41d6-ae0f-28dce272a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-544012429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bdb386-bc30-4c5e-a7c8-6efca438c966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:27Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:26 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2752e00-aafc-4a8b-89d4-69fd49307185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2752e00-aafc-4a8b-89d4-69fd49307185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972057f6-1328-4501-b011-520dec140845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972057f6-1328-4501-b011-520dec140845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41bdb386-bc30-4c5e-a7c8-6efca438c966', 'volume_name': 'volume-41bdb386-bc30-4c5e-a7c8-6efca438c966', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbaa006-ff3e-4828-90bc-a6f86ac1e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbaa006-ff3e-4828-90bc-a6f86ac1e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56526fe4-4385-487b-aa49-ebad348fda49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:26 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Volume 41bdb386-bc30-4c5e-a7c8-6efca438c966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41bdb386-bc30-4c5e-a7c8-6efca438c966', 'volume_size': 1} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf 1G" returned: 0 in 0.619s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:26 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf Apr 13 14:19:26 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:27 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:27 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf is being set with open permissions: ugo+rw Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:27 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf Apr 13 14:19:27 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Flow 'volume_create_manager' (ec5e870f-20ff-4e60-9675-f32eeecae463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fae030-b50d-4a85-9411-9519fef722a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fae030-b50d-4a85-9411-9519fef722a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-21485399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0dec5b-58ed-47f0-b1fe-02bd07a1c485,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='776e63adfa8e496496576c032ed32955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:28Z,use_quota=True,user_id='18b7b24b3a464f2d9cb9fb3a6f75b623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:27 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7658229c-441e-4bc5-9032-41e6fefcb741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7658229c-441e-4bc5-9032-41e6fefcb741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce832c36-e9ef-4418-84ca-e7c547975d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce832c36-e9ef-4418-84ca-e7c547975d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0dec5b-58ed-47f0-b1fe-02bd07a1c485', 'volume_name': 'volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a437b507-93e0-48ff-8124-ebb9f1885cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a437b507-93e0-48ff-8124-ebb9f1885cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31628f66-f9f9-4a79-b11f-0a7e8a8db032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:27 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Volume ae0dec5b-58ed-47f0-b1fe-02bd07a1c485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485', 'volume_size': 1} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf" returned: 0 in 0.508s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.210s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-544012429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bdb386-bc30-4c5e-a7c8-6efca438c966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:27Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Creating volume 41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:27 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:27 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 1073741824 Apr 13 14:19:27 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:27 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a749636c-d4c6-46aa-93dc-c26988cdad89 tempest-VolumesDeleteCascade-412500601 None] Create snapshot completed successfully Apr 13 14:19:28 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 1073741824" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:28 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:28 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:28 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 0.389s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-21485399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0dec5b-58ed-47f0-b1fe-02bd07a1c485,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='776e63adfa8e496496576c032ed32955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:28Z,use_quota=True,user_id='18b7b24b3a464f2d9cb9fb3a6f75b623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Creating volume ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:28 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56526fe4-4385-487b-aa49-ebad348fda49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41bdb386-bc30-4c5e-a7c8-6efca438c966', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef34c942-4ae3-4a4a-89cc-833d6f6b2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:28 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 1073741824 Apr 13 14:19:28 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:28 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Volume volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 (41bdb386-bc30-4c5e-a7c8-6efca438c966): created successfully Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef34c942-4ae3-4a4a-89cc-833d6f6b2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (0b387544-cbab-41bc-8ea6-f6a85713e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-94834493-0720-46e5-aba3-ca6038b31a55 tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-53ae7897-4a91-4325-b1ee-d68ca0f0c755-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-53ae7897-4a91-4325-b1ee-d68ca0f0c755-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Performing cascade delete. {{(pid=82621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-3a710705-ca82-4bca-ae20-0b7a6e755eaf-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-3a710705-ca82-4bca-ae20-0b7a6e755eaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-3a710705-ca82-4bca-ae20-0b7a6e755eaf" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-3a710705-ca82-4bca-ae20-0b7a6e755eaf" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Deleting offline snapshot 3a710705-ca82-4bca-ae20-0b7a6e755eaf of volume 53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] snapshot_file for this snap is: volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d4198-7655-4d59-bda1-98389a49b036]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:28 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf Apr 13 14:19:28 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:29 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 1073741824" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:29 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 Apr 13 14:19:29 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:29 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[34162f98-b7e9-422f-86a3-d9da0c732d14]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:29 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:29 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:29 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485" returned: 0 in 0.432s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31628f66-f9f9-4a79-b11f-0a7e8a8db032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d428c0f-e289-4dff-bb08-9280f7310114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:29 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Volume volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 (ae0dec5b-58ed-47f0-b1fe-02bd07a1c485): created successfully Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d428c0f-e289-4dff-bb08-9280f7310114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Flow 'volume_create_manager' (ec5e870f-20ff-4e60-9675-f32eeecae463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5610a8f5-60c1-4290-992b-c4d3ab252516 tempest-VolumesListTestJSON-1082430606 None] Created volume successfully. Apr 13 14:19:29 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:29 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf Apr 13 14:19:29 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Flow 'volume_create_manager' (a7515fae-342b-4e41-b2c3-781367b465b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310c1d9e-87c4-4a23-932c-4de2a94c6ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310c1d9e-87c4-4a23-932c-4de2a94c6ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1794007767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c566ae-9b32-4a01-b5eb-1bb4c2d01973,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='776e63adfa8e496496576c032ed32955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:30Z,use_quota=True,user_id='18b7b24b3a464f2d9cb9fb3a6f75b623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61eb3c3-dba7-466f-a819-6f997caaa3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61eb3c3-dba7-466f-a819-6f997caaa3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9659a0e-e873-45f3-8610-f0f14239d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9659a0e-e873-45f3-8610-f0f14239d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c566ae-9b32-4a01-b5eb-1bb4c2d01973', 'volume_name': 'volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c23776-0b13-40f0-b2d4-a5cd3aa46d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c23776-0b13-40f0-b2d4-a5cd3aa46d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c972236-c91e-44ee-a676-12d9550555f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Volume 24c566ae-9b32-4a01-b5eb-1bb4c2d01973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973', 'volume_size': 1} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1794007767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c566ae-9b32-4a01-b5eb-1bb4c2d01973,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='776e63adfa8e496496576c032ed32955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:30Z,use_quota=True,user_id='18b7b24b3a464f2d9cb9fb3a6f75b623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Creating volume 24c566ae-9b32-4a01-b5eb-1bb4c2d01973 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:30 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:30 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 1073741824 Apr 13 14:19:30 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (13de4fae-6140-4aac-b9df-d55a17db437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830173e0-0b46-4ed6-a3f7-7f9e038ba7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830173e0-0b46-4ed6-a3f7-7f9e038ba7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1232997563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048414f9-bba4-429e-9b33-2ecda37e4b87,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=41bdb386-bc30-4c5e-a7c8-6efca438c966,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:30Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c285a43-f56a-43b5-8fa4-30c4b16c21d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c285a43-f56a-43b5-8fa4-30c4b16c21d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37a9cd1-6387-4876-a932-23443628ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37a9cd1-6387-4876-a932-23443628ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '048414f9-bba4-429e-9b33-2ecda37e4b87', 'volume_name': 'volume-048414f9-bba4-429e-9b33-2ecda37e4b87', 'volume_size': 1, 'source_volid': '41bdb386-bc30-4c5e-a7c8-6efca438c966', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3d35f9-f386-4647-a876-5beba0745b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3d35f9-f386-4647-a876-5beba0745b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b79369-15ce-4e33-a3ed-df38073fcd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Volume 048414f9-bba4-429e-9b33-2ecda37e4b87: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-048414f9-bba4-429e-9b33-2ecda37e4b87', 'volume_size': 1, 'source_volid': '41bdb386-bc30-4c5e-a7c8-6efca438c966', 'source_volstatus': 'available'} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:30 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf" returned: 0 in 0.530s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:30 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf Apr 13 14:19:30 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:30 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 1073741824" returned: 0 in 0.468s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:30 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 Apr 13 14:19:30 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:30 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.3a710705-ca82-4bca-ae20-0b7a6e755eaf" returned: 0 in 0.442s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-3a710705-ca82-4bca-ae20-0b7a6e755eaf" released by "_delete_snapshot" :: held 1.997s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" released by "delete_snapshot" :: held 2.008s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Created reservations ['46b0a588-128f-4888-be19-d096486871a7', 'b1ad7681-b3a9-44c9-8076-500d0beae33c', 'df2d222f-7612-4f9e-aa69-968521a9f315', 'e3fb6954-a7ce-43d4-986d-a47fd1beab1a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:30 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Delete snapshot completed successfully. Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-3a710705-ca82-4bca-ae20-0b7a6e755eaf-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-cfe8b39f-f286-407c-8191-231ec5962521-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-cfe8b39f-f286-407c-8191-231ec5962521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-cfe8b39f-f286-407c-8191-231ec5962521" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-cfe8b39f-f286-407c-8191-231ec5962521" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Deleting offline snapshot cfe8b39f-f286-407c-8191-231ec5962521 of volume 53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] snapshot_file for this snap is: volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[378768b4-2c43-4046-b2e3-9bcd1c760d71]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:30 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:30 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:30 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.813s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:30 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Cloning volume 41bdb386-bc30-4c5e-a7c8-6efca438c966 to volume 048414f9-bba4-429e-9b33-2ecda37e4b87 Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c972236-c91e-44ee-a676-12d9550555f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea93438-f953-4bb3-b0e4-dd3b5050be9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:30 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Volume volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 (24c566ae-9b32-4a01-b5eb-1bb4c2d01973): created successfully Apr 13 14:19:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea93438-f953-4bb3-b0e4-dd3b5050be9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Flow 'volume_create_manager' (a7515fae-342b-4e41-b2c3-781367b465b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Creating offline snapshot 7653db71-7e51-445c-94bd-57e09911fdcf of volume 41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:31 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ddcaea5c-4245-4311-b628-c6dd9bf79ecf tempest-VolumesListTestJSON-1082430606 None] Created volume successfully. Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f73be1-7d34-4b41-925e-c320ffd33d98]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:31 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:31 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:31 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435af7d-dd50-4bb2-9324-74d35cfd6803]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:31 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 Apr 13 14:19:31 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:31 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 0.479s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:31 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf 1G Apr 13 14:19:31 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:31 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:31 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:31 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:31 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf 1G" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:32 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf Apr 13 14:19:32 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:32 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:32 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521 Apr 13 14:19:32 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Flow 'volume_create_manager' (98e9fe77-fd39-4c02-93f1-befe1acb4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4a16b2-e93a-4306-97ac-e735fc509589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4a16b2-e93a-4306-97ac-e735fc509589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1858240999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='776e63adfa8e496496576c032ed32955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:32Z,use_quota=True,user_id='18b7b24b3a464f2d9cb9fb3a6f75b623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9290d69c-dac6-40ae-949b-72bf8bd53b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9290d69c-dac6-40ae-949b-72bf8bd53b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f21011-6cbf-469c-a2cd-c7a979ab5cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f21011-6cbf-469c-a2cd-c7a979ab5cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5', 'volume_name': 'volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e55f82-b083-480f-8302-9135c9c3cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e55f82-b083-480f-8302-9135c9c3cab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7944f43-3e67-4ff9-a0a2-8977c5a1a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:32 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Volume bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5', 'volume_size': 1} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:32 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:32 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf is being set with open permissions: ugo+rw Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:32 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf Apr 13 14:19:32 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:32 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755.cfe8b39f-f286-407c-8191-231ec5962521" returned: 0 in 0.441s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-cfe8b39f-f286-407c-8191-231ec5962521" released by "_delete_snapshot" :: held 1.915s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" released by "delete_snapshot" :: held 1.928s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Created reservations ['73491134-9946-4145-b7f9-b51bee167398', 'ce193d9d-2923-4726-96f7-dd05d6aa49dd', '3f07095e-5dcb-4f7b-9b6f-a869e206c1e4', '18c8ee24-56e4-4ca5-ba07-f6585ebe5738'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:32 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Delete snapshot completed successfully. Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-cfe8b39f-f286-407c-8191-231ec5962521-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Snapshots deleted, issuing volume delete {{(pid=82621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3166a00-9f59-46b0-b69a-5d54657da118]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:32 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf" returned: 0 in 0.431s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:32 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 Apr 13 14:19:32 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:32 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info Apr 13 14:19:32 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:33 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:33 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info" returned: 0 in 0.425s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:33 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info is being set with open permissions: ugo+rw Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:33 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755 Apr 13 14:19:33 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:33 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info Apr 13 14:19:33 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:33 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-53ae7897-4a91-4325-b1ee-d68ca0f0c755" returned: 0 in 0.421s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-53ae7897-4a91-4325-b1ee-d68ca0f0c755" released by "delete_volume" :: held 0.938s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:33 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.info" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-048414f9-bba4-429e-9b33-2ecda37e4b87" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-048414f9-bba4-429e-9b33-2ecda37e4b87" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] snapshot: 7653db71-7e51-445c-94bd-57e09911fdcf, volume: 048414f9-bba4-429e-9b33-2ecda37e4b87, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e818e8-5270-4c9c-9483-05bcdb57e377]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Created reservations ['d1bc2f09-4786-4b81-a109-d4c181b0096f', 'bf8417bd-c54a-49b2-bab1-d3cf926ef2e7', '6cf8e657-4580-4c8d-8e32-730acfeaad75', 'bc04e5c0-25f7-4c0a-9841-735bbdf89dd0'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:33 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf Apr 13 14:19:33 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:33 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:33 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Flow 'volume_create_manager' (a3141ebf-6c68-46f6-b86e-91675eb466e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:34 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2245f3e9-7210-499e-a631-7e9e95520951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:34 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2245f3e9-7210-499e-a631-7e9e95520951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1806797050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f2b59d-4673-4871-a193-b9c8d8642737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90727327c4db457481eec1b48fe3fb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:34Z,use_quota=True,user_id='1dfc2e27f9b241b79fd54a4867b3d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c083ac-5aae-4150-b15b-e607ed2ef089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c083ac-5aae-4150-b15b-e607ed2ef089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a304114-5d72-41a9-baee-6a6cf0b3a97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a304114-5d72-41a9-baee-6a6cf0b3a97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f2b59d-4673-4871-a193-b9c8d8642737', 'volume_name': 'volume-92f2b59d-4673-4871-a193-b9c8d8642737', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cbf436-f05c-4fa5-b7b5-3eaef2660ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20cbf436-f05c-4fa5-b7b5-3eaef2660ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9591c1e6-e842-4665-80b7-4a76c45ad3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:34 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Volume 92f2b59d-4673-4871-a193-b9c8d8642737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f2b59d-4673-4871-a193-b9c8d8642737', 'volume_size': 1} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:34 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Deleted volume successfully. Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf" returned: 0 in 0.563s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41bdb386-bc30-4c5e-a7c8-6efca438c966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3cec9f-893c-4f2f-8a7d-55def374fc4e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fd67c1db-5428-43fa-baf6-938a933ca82b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-53ae7897-4a91-4325-b1ee-d68ca0f0c755-delete_volume" released by "delete_volume" :: held 5.759s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:34 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:34 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:34 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 0.479s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:19:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:34 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 Apr 13 14:19:34 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:36 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87" returned: 0 in 1.961s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:36 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f4764-36c8-4b34-85aa-3e62efd946c0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:36 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:36 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:37 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 0.617s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:19:37 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Converted 1024.00 MB image at 521.79 MB/s Apr 13 14:19:37 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 is being set with open permissions: ugo+rw Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:37 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 Apr 13 14:19:37 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:37 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87" returned: 0 in 0.393s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-048414f9-bba4-429e-9b33-2ecda37e4b87" released by "_copy_volume_from_snapshot" :: held 4.058s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-7653db71-7e51-445c-94bd-57e09911fdcf" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-7653db71-7e51-445c-94bd-57e09911fdcf" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Deleting offline snapshot 7653db71-7e51-445c-94bd-57e09911fdcf of volume 41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] snapshot_file for this snap is: volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8decd414-ae05-43eb-abd7-cb34f8d44008]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:37 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf Apr 13 14:19:37 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:38 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf" returned: 0 in 0.472s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41bdb386-bc30-4c5e-a7c8-6efca438c966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:38 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed310f-1076-4728-8ac6-c23de4044954]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:38 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:38 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:38 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:38 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf Apr 13 14:19:38 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:39 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf" returned: 0 in 0.454s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:39 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf Apr 13 14:19:39 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:39 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966.7653db71-7e51-445c-94bd-57e09911fdcf" returned: 0 in 0.421s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-7653db71-7e51-445c-94bd-57e09911fdcf" released by "_delete_snapshot" :: held 1.859s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=169,cinder:INSERT=46,cinder:UPDATE=244,cinder:DELETE=18 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=233,cinder:DELETE=22,cinder:SELECT=206,cinder:INSERT=77 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.776s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.356s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1858240999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='776e63adfa8e496496576c032ed32955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:32Z,use_quota=True,user_id='18b7b24b3a464f2d9cb9fb3a6f75b623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Creating volume bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:39 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b79369-15ce-4e33-a3ed-df38073fcd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048414f9-bba4-429e-9b33-2ecda37e4b87', 'volume_size': 1, 'source_volid': '41bdb386-bc30-4c5e-a7c8-6efca438c966', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab3b029-e895-46c5-b06b-dcd0f3dd6686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:39 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 1073741824 Apr 13 14:19:39 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Volume volume-048414f9-bba4-429e-9b33-2ecda37e4b87 (048414f9-bba4-429e-9b33-2ecda37e4b87): created successfully Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab3b029-e895-46c5-b06b-dcd0f3dd6686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (13de4fae-6140-4aac-b9df-d55a17db437c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:39 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b033d789-a953-4c8c-a613-f478bd04ffcf tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:40 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 1073741824" returned: 0 in 0.483s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:40 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 Apr 13 14:19:40 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:40 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5" returned: 0 in 0.440s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.348s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1806797050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f2b59d-4673-4871-a193-b9c8d8642737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90727327c4db457481eec1b48fe3fb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:34Z,use_quota=True,user_id='1dfc2e27f9b241b79fd54a4867b3d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Creating volume 92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:40 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7944f43-3e67-4ff9-a0a2-8977c5a1a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660ce8f5-7a8f-4596-ab9b-7c1865c9b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:40 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Volume volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 (bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5): created successfully Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660ce8f5-7a8f-4596-ab9b-7c1865c9b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:40 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Flow 'volume_create_manager' (98e9fe77-fd39-4c02-93f1-befe1acb4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:40 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 1073741824 Apr 13 14:19:40 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-976fc480-9efe-4a32-b083-651a9fdd2ec6 tempest-VolumesListTestJSON-1082430606 None] Created volume successfully. Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (a4920ac7-a33d-4661-859a-0601e2b52366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6a5e2a-59a3-409f-baac-680ffcfc2c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6a5e2a-59a3-409f-baac-680ffcfc2c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2099653655',display_name='tempest-VolumesGetTest-Volume-850616691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945c17dd-091d-40b8-9977-66a602d3a994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:41Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73522597-7389-4277-b0b8-9f9e29af23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73522597-7389-4277-b0b8-9f9e29af23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec2f0de-f333-401f-b17e-d05cf34e6ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec2f0de-f333-401f-b17e-d05cf34e6ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945c17dd-091d-40b8-9977-66a602d3a994', 'volume_name': 'volume-945c17dd-091d-40b8-9977-66a602d3a994', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d81138-8636-4478-af37-b0f01f2020c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d81138-8636-4478-af37-b0f01f2020c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65ca05b-ea55-40c6-ad17-92b7dcb588f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:41 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Volume 945c17dd-091d-40b8-9977-66a602d3a994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945c17dd-091d-40b8-9977-66a602d3a994', 'volume_size': 1} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:41 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 1073741824" returned: 0 in 0.576s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:41 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:41 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:41 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2099653655',display_name='tempest-VolumesGetTest-Volume-850616691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945c17dd-091d-40b8-9977-66a602d3a994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:41Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Creating volume 945c17dd-091d-40b8-9977-66a602d3a994 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:41 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9591c1e6-e842-4665-80b7-4a76c45ad3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f2b59d-4673-4871-a193-b9c8d8642737', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:41 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 1073741824 Apr 13 14:19:41 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6773dc-cd15-419c-8b13-b1ace194596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:41 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Volume volume-92f2b59d-4673-4871-a193-b9c8d8642737 (92f2b59d-4673-4871-a193-b9c8d8642737): created successfully Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6773dc-cd15-419c-8b13-b1ace194596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Flow 'volume_create_manager' (a3141ebf-6c68-46f6-b86e-91675eb466e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:41 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1acb2bc3-9c48-4245-a8d1-493cd7dd8f35 tempest-VolumesDeleteCascade-412500601 None] Created volume successfully. Apr 13 14:19:42 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 1073741824" returned: 0 in 0.543s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:42 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 Apr 13 14:19:42 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:42 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65ca05b-ea55-40c6-ad17-92b7dcb588f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945c17dd-091d-40b8-9977-66a602d3a994', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10778ad0-b528-4732-af2b-c4ae5b7ac0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Volume volume-945c17dd-091d-40b8-9977-66a602d3a994 (945c17dd-091d-40b8-9977-66a602d3a994): created successfully Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10778ad0-b528-4732-af2b-c4ae5b7ac0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (a4920ac7-a33d-4661-859a-0601e2b52366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3ff8c736-5765-487c-b4a3-bf739fb08b69 tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Creating offline snapshot f737895c-4db1-4eee-8162-dcca60750165 of volume 92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6564e81a-3e5f-4c08-97c3-44ba5da445be]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:42 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:42 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-945c17dd-091d-40b8-9977-66a602d3a994-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Lock "cinder-945c17dd-091d-40b8-9977-66a602d3a994-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-945c17dd-091d-40b8-9977-66a602d3a994" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-945c17dd-091d-40b8-9977-66a602d3a994" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba5b1b-1a7e-4a8c-9f6f-0865b37e9843]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:43 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.539s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:43 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 1G Apr 13 14:19:43 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:43 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 Apr 13 14:19:43 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "cinder-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "cinder-quobyte-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-quobyte-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfabd38-2249-4238-a6b8-3bfa3545797a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:43 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 Apr 13 14:19:43 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:43 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:43 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 1G" returned: 0 in 0.525s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f2b59d-4673-4871-a193-b9c8d8642737 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994" returned: 0 in 0.547s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:43 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f2b59d-4673-4871-a193-b9c8d8642737 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 Apr 13 14:19:43 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:43 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994 Apr 13 14:19:43 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:44 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:44 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5 Apr 13 14:19:44 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:44 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-945c17dd-091d-40b8-9977-66a602d3a994" returned: 0 in 0.424s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-945c17dd-091d-40b8-9977-66a602d3a994" released by "delete_volume" :: held 0.994s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:44 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f2b59d-4673-4871-a193-b9c8d8642737 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165" returned: 0 in 0.473s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:44 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 is being set with open permissions: ugo+rw Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Created reservations ['c944b70c-0f66-4070-9bb6-23f990d88d96', '464e7feb-d38a-43f4-b2e6-8fa45b270eb5', 'ba073647-27af-47e4-bb84-55022eaf0920', 'be419f89-f0ae-4a57-a406-7d83c1b74e5f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:44 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 Apr 13 14:19:44 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:44 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:44 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:44 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5" returned: 0 in 0.439s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-quobyte-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5" released by "delete_volume" :: held 0.942s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Created reservations ['0efd92f8-8094-4adc-b8b4-37de545b1c99', '81742584-cf77-47cd-b4e4-3153c7333dce', '12fadf62-df46-4056-8085-5674fcbc9463', '5822f1fe-64a1-49fb-b3f0-9bb9da6d0002'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:44 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:44 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "cinder-24c566ae-9b32-4a01-b5eb-1bb4c2d01973-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-24c566ae-9b32-4a01-b5eb-1bb4c2d01973-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "cinder-quobyte-24c566ae-9b32-4a01-b5eb-1bb4c2d01973" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-quobyte-24c566ae-9b32-4a01-b5eb-1bb4c2d01973" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[806bf13c-db94-4bce-a6ca-24964b5a5033]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:44 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:44 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 Apr 13 14:19:44 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:19:44 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165" returned: 0 in 0.532s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-033635fb-6a66-4d5f-9bb5-fe3176fe8cc6 tempest-VolumesGetTest-1835127947 None] Lock "cinder-945c17dd-091d-40b8-9977-66a602d3a994-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:45 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info Apr 13 14:19:45 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:45 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.492s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Deleted volume successfully. Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93fcc236-a107-4dbf-b27d-0b66e744c589 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-bbe6c87a-5705-4042-b2eb-4a4cc5eba7a5-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:45 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:45 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973 Apr 13 14:19:45 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:45 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info" returned: 0 in 0.417s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:45 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info is being set with open permissions: ugo+rw Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:45 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info Apr 13 14:19:45 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-048414f9-bba4-429e-9b33-2ecda37e4b87-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Lock "cinder-048414f9-bba4-429e-9b33-2ecda37e4b87-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-048414f9-bba4-429e-9b33-2ecda37e4b87" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-048414f9-bba4-429e-9b33-2ecda37e4b87" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66861f1-82ab-4b28-84f1-f6fa3c3a5f0b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:45 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 Apr 13 14:19:45 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:45 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-24c566ae-9b32-4a01-b5eb-1bb4c2d01973" returned: 0 in 0.454s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-quobyte-24c566ae-9b32-4a01-b5eb-1bb4c2d01973" released by "delete_volume" :: held 0.965s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Created reservations ['38be760b-53ea-4785-b1aa-a07350f7a7bb', 'f09602b1-e47d-4038-8012-f95924e9cbda', '7855ed88-68ae-49b4-82c2-517820fc9630', 'b64b0374-73e2-4b6f-8907-11c9f6e6aaa7'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:45 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.info" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0a511432-c6ff-4684-ab2a-943a1f1d3e05 tempest-VolumesDeleteCascade-412500601 None] Create snapshot completed successfully Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:45 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:45 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "cinder-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "cinder-quobyte-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-quobyte-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b2578-f00b-4b98-a49e-99efebf7c0f8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:46 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87" returned: 0 in 0.516s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:46 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87 Apr 13 14:19:46 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:46 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 Apr 13 14:19:46 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Flow 'volume_create_manager' (1fee7784-9cc7-4ed1-82d5-004bccca1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571053fe-01ce-4524-9f9e-90510b41a9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571053fe-01ce-4524-9f9e-90510b41a9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1765422320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291e5208-4243-4622-8667-4a8e5b915196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90727327c4db457481eec1b48fe3fb65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f737895c-4db1-4eee-8162-dcca60750165,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:46Z,use_quota=True,user_id='1dfc2e27f9b241b79fd54a4867b3d156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b33cb3c-6970-463b-8578-1584c60f10b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b33cb3c-6970-463b-8578-1584c60f10b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fe962b-1cd3-438d-a5dd-5bfffe342e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fe962b-1cd3-438d-a5dd-5bfffe342e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '291e5208-4243-4622-8667-4a8e5b915196', 'volume_name': 'volume-291e5208-4243-4622-8667-4a8e5b915196', 'volume_size': 1, 'snapshot_id': 'f737895c-4db1-4eee-8162-dcca60750165'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c2f36d-615e-41e4-ba3f-cd81a886de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c2f36d-615e-41e4-ba3f-cd81a886de72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2dd2ef-07b9-4864-8db0-42f1d0e91366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:46 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Volume 291e5208-4243-4622-8667-4a8e5b915196: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-291e5208-4243-4622-8667-4a8e5b915196', 'volume_size': 1, 'snapshot_id': 'f737895c-4db1-4eee-8162-dcca60750165'} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-f737895c-4db1-4eee-8162-dcca60750165-291e5208-4243-4622-8667-4a8e5b915196" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-f737895c-4db1-4eee-8162-dcca60750165-291e5208-4243-4622-8667-4a8e5b915196" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Creating volume 291e5208-4243-4622-8667-4a8e5b915196 from snapshot f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-291e5208-4243-4622-8667-4a8e5b915196" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-291e5208-4243-4622-8667-4a8e5b915196" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] snapshot: f737895c-4db1-4eee-8162-dcca60750165, volume: 291e5208-4243-4622-8667-4a8e5b915196, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6595f858-23d2-4a20-bfd9-265d423ec72b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:46 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.548s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Deleted volume successfully. Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-eb06b884-5384-45c5-b46b-7daf1dba1c18 tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-24c566ae-9b32-4a01-b5eb-1bb4c2d01973-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:46 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 Apr 13 14:19:46 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:46 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:46 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485 Apr 13 14:19:46 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:46 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-048414f9-bba4-429e-9b33-2ecda37e4b87" returned: 0 in 0.496s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-048414f9-bba4-429e-9b33-2ecda37e4b87" released by "delete_volume" :: held 1.034s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Created reservations ['c655f3ab-4a01-4551-b39e-aede2dca59e2', 'd2b84468-8731-4701-a7ed-5c13a41001e5', 'b7f004e2-f884-4d8f-ada2-1bd4438f0aac', 'bae66967-f86b-43da-bfb0-ee29508b7a3f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:46 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:46 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:46 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165" returned: 0 in 0.521s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f2b59d-4673-4871-a193-b9c8d8642737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1205d576-ebb3-40de-8351-a48596f8f8ac]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:47 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-quobyte-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485" released by "delete_volume" :: held 0.970s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:47 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:47 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Created reservations ['8c6fe5a9-6b34-40f8-a6e6-7116ad8172f6', '329053c6-7a82-42bd-aa43-99db7f00d216', '4310b93a-b0d1-4450-acf6-edb4ce36363a', 'd2dfac96-178b-48b4-9562-8278f2189175'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:47 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.423s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:19:47 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d5c216ba-c578-4b03-91b0-91dc9e02ea07 tempest-VolumesGetTest-1835127947 None] Lock "cinder-048414f9-bba4-429e-9b33-2ecda37e4b87-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:47 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:47 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.540s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:47 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 Apr 13 14:19:47 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:47 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Deleted volume successfully. Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-86b88387-0dce-408e-aea0-9f225c3db64f tempest-VolumesListTestJSON-1082430606 None] Lock "cinder-ae0dec5b-58ed-47f0-b1fe-02bd07a1c485-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-41bdb386-bc30-4c5e-a7c8-6efca438c966-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Lock "cinder-41bdb386-bc30-4c5e-a7c8-6efca438c966-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-41bdb386-bc30-4c5e-a7c8-6efca438c966" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-41bdb386-bc30-4c5e-a7c8-6efca438c966" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae6d97c-0f01-44c6-9be3-3f87a3327828]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:47 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:47 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:48 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 1.010s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:48 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966 Apr 13 14:19:48 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:49 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-41bdb386-bc30-4c5e-a7c8-6efca438c966" returned: 0 in 0.901s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-41bdb386-bc30-4c5e-a7c8-6efca438c966" released by "delete_volume" :: held 1.951s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:49 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196" returned: 0 in 2.253s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e56b3-7f30-46de-8327-24b9dae8f240]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Created reservations ['7d2e2b9e-2b54-4ad6-aff5-fe2e089757f4', 'f271313b-e967-4d19-b81d-abade650931b', '7316363f-10c0-4bbe-af0c-92feff5ccf1e', 'a93eb1ff-3387-4cf6-a86d-0a75d07978b0'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:49 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:49 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:49 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:49 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:50 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Flow 'volume_create_manager' (1fcbaca5-fe91-4e79-b28d-781300cd3cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e381c2-536d-4086-8d17-fcb9db3a13cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.525s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e381c2-536d-4086-8d17-fcb9db3a13cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-879125885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111c52395a89437385839c898c4f76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:50Z,use_quota=True,user_id='92d7c75d21c34a10822dc7121015989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc85b229-ea42-4b09-b229-6086c02e113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc85b229-ea42-4b09-b229-6086c02e113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11abdadb-d7a5-44db-b15f-0b1e427ce5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11abdadb-d7a5-44db-b15f-0b1e427ce5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6', 'volume_name': 'volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6', 'volume_size': 2}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5621af2-8997-490e-b6a1-b16f611d6908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5621af2-8997-490e-b6a1-b16f611d6908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a041e9-21aa-4962-b019-7a435626ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Volume 6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6', 'volume_size': 2} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a240285e-6def-42d1-acff-da8a7da2776d tempest-VolumesGetTest-1835127947 None] Lock "cinder-41bdb386-bc30-4c5e-a7c8-6efca438c966-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:50 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.730s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:19:50 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Converted 1024.00 MB image at 454.38 MB/s Apr 13 14:19:50 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 is being set with open permissions: ugo+rw Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:50 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 Apr 13 14:19:50 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (db8a8f99-81d3-468e-becf-ae4ef4f5264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcc2ca4-ceff-40a3-8f43-1317e4145df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcc2ca4-ceff-40a3-8f43-1317e4145df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1663740956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8771da4-5460-4187-8a99-b263ceca129b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:51Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eacbfc-fe3a-4ef1-ba16-77ac5b13b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eacbfc-fe3a-4ef1-ba16-77ac5b13b77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a65ce0-b4c5-44d3-ae9d-5faac4289599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.image.glance [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Creating Keystone auth plugin from conf {{(pid=82621) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a65ce0-b4c5-44d3-ae9d-5faac4289599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8771da4-5460-4187-8a99-b263ceca129b', 'volume_name': 'volume-f8771da4-5460-4187-8a99-b263ceca129b', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e12e01-1666-45e1-ab74-d8b365481bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e12e01-1666-45e1-ab74-d8b365481bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c291c513-b4e5-4ed0-9982-8a21f9b57c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:50 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Volume f8771da4-5460-4187-8a99-b263ceca129b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8771da4-5460-4187-8a99-b263ceca129b', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Trying to clone f8771da4-5460-4187-8a99-b263ceca129b from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]). {{(pid=82621) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 14:19:50 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196" returned: 0 in 0.453s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-291e5208-4243-4622-8667-4a8e5b915196" released by "_copy_volume_from_snapshot" :: held 4.552s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-f737895c-4db1-4eee-8162-dcca60750165-291e5208-4243-4622-8667-4a8e5b915196" released by "_create_volume_from_snapshot" :: held 4.575s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.583s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-879125885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111c52395a89437385839c898c4f76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:50Z,use_quota=True,user_id='92d7c75d21c34a10822dc7121015989e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Creating volume 6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:50 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 2147483648 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:51 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 2147483648 Apr 13 14:19:51 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2dd2ef-07b9-4864-8db0-42f1d0e91366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291e5208-4243-4622-8667-4a8e5b915196', 'volume_size': 1, 'snapshot_id': 'f737895c-4db1-4eee-8162-dcca60750165'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2462dac4-60d4-458e-a26d-49b92eda1dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 14:19:51 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Image download 20.69 MB at 20.69 MB/s Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[82757c77-42a4-4d17-9e2b-0a8acaeb47c0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:51 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Volume volume-291e5208-4243-4622-8667-4a8e5b915196 (291e5208-4243-4622-8667-4a8e5b915196): created successfully Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2462dac4-60d4-458e-a26d-49b92eda1dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Flow 'volume_create_manager' (1fee7784-9cc7-4ed1-82d5-004bccca1daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:51 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-68dc5383-17c5-4e24-a6bd-6879cb3a04e5 tempest-VolumesDeleteCascade-412500601 None] Created volume successfully. Apr 13 14:19:51 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD Apr 13 14:19:51 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:51 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 2147483648" returned: 0 in 0.523s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:51 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 Apr 13 14:19:51 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:51 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 is fetched for user 31d7b7332eed44c7927b21273dc2b690. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfb6ef-3aa3-40c1-9aba-a46f98bf5f37]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:51 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD Apr 13 14:19:51 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-92f2b59d-4673-4871-a193-b9c8d8642737-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-92f2b59d-4673-4871-a193-b9c8d8642737-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Performing cascade delete. {{(pid=82621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-f737895c-4db1-4eee-8162-dcca60750165-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-f737895c-4db1-4eee-8162-dcca60750165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-92f2b59d-4673-4871-a193-b9c8d8642737" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-92f2b59d-4673-4871-a193-b9c8d8642737" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-f737895c-4db1-4eee-8162-dcca60750165" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-f737895c-4db1-4eee-8162-dcca60750165" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Deleting offline snapshot f737895c-4db1-4eee-8162-dcca60750165 of volume 92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] snapshot_file for this snap is: volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[804efcee-ad31-4e1c-b001-e0082bc2bb08]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:51 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 Apr 13 14:19:51 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:51 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:51 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a041e9-21aa-4962-b019-7a435626ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6', 'volume_size': 2}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99e1156-c342-4801-b77b-7d19806d726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:52 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Volume volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 (6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6): created successfully Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99e1156-c342-4801-b77b-7d19806d726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Flow 'volume_create_manager' (1fcbaca5-fe91-4e79-b28d-781300cd3cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a7d7bc89-36ff-4fb0-9656-4f7ede85f194 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Created volume successfully. Apr 13 14:19:52 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1663740956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8771da4-5460-4187-8a99-b263ceca129b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:51Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Creating volume f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:52 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:52 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b 1073741824 Apr 13 14:19:52 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:52 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165" returned: 0 in 0.494s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f2b59d-4673-4871-a193-b9c8d8642737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be18bc2-9703-405c-b0d4-2c4809dd5428]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:52 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:52 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:52 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b 1073741824" returned: 0 in 0.520s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:52 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:19:52 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:52 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.529s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:52 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 Apr 13 14:19:52 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:53 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 0 in 0.449s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.568s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Creating offline snapshot 45693e21-3c77-4b97-8452-e575eb9c8b61 of volume 6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Attempting download of c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume f8771da4-5460-4187-8a99-b263ceca129b. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c684319b-478b-4fd3-aa85-b32da746e11e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921cf07-9d11-4428-a0d3-a920865418f5]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:53 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 Apr 13 14:19:53 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:53 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm Apr 13 14:19:53 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:53 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165" returned: 0 in 0.444s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:53 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165 Apr 13 14:19:53 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:53 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" returned: 0 in 0.483s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 2G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:53 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:53 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 2G Apr 13 14:19:53 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:53 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm Apr 13 14:19:53 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:53 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737.f737895c-4db1-4eee-8162-dcca60750165" returned: 0 in 0.419s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-f737895c-4db1-4eee-8162-dcca60750165" released by "_delete_snapshot" :: held 1.927s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-92f2b59d-4673-4871-a193-b9c8d8642737" released by "delete_snapshot" :: held 1.942s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Created reservations ['b24fb6e3-b423-44d2-82fc-18d24f704874', '3921ce7a-5a69-4946-8b90-5f8b58ecd6c6', 'c42cd36f-b351-4ae4-9577-c0d0755b143f', '4796ea25-c13d-455b-8114-a15a5c274677'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Delete snapshot completed successfully. Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-f737895c-4db1-4eee-8162-dcca60750165-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Snapshots deleted, issuing volume delete {{(pid=82621) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-92f2b59d-4673-4871-a193-b9c8d8642737" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-92f2b59d-4673-4871-a193-b9c8d8642737" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff64ac5-6f2a-4ac0-bd35-966d22c4a61d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:54 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:54 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 2G" returned: 0 in 0.518s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm" returned: 1 in 0.511s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c223e7fa-335f-4690-8d1c-349d8cc0aad3_ypaebutm' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[819b9171-a957-447e-94a8-c766a1e76529]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 Apr 13 14:19:54 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:54 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD Apr 13 14:19:54 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:54 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.494s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737 Apr 13 14:19:54 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:54 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61" returned: 0 in 0.439s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:54 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 is being set with open permissions: ugo+rw Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 Apr 13 14:19:54 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:54 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] c223e7fa-335f-4690-8d1c-349d8cc0aad3 was qcow2, converting to raw {{(pid=82621) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:19:54 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:54 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-92f2b59d-4673-4871-a193-b9c8d8642737" returned: 0 in 0.417s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-92f2b59d-4673-4871-a193-b9c8d8642737" released by "delete_volume" :: held 0.941s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Created reservations ['3b36dc50-a16e-479c-9610-8798e24aaf97', '36549b46-a0e7-4831-9ebd-bb1446c5df5a', 'c97dc323-891c-49aa-8865-35c9703899e8', '26f88452-7e10-42ff-ab72-44731505e46e'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:54 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:54 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:55 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:55 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info Apr 13 14:19:55 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-291e5208-4243-4622-8667-4a8e5b915196-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-291e5208-4243-4622-8667-4a8e5b915196-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "cinder-quobyte-291e5208-4243-4622-8667-4a8e5b915196" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-291e5208-4243-4622-8667-4a8e5b915196" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb1f135-20e8-41b4-9142-5c701a8f7ee6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:55 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 Apr 13 14:19:55 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:55 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.511s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Deleted volume successfully. Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-b0aadfc7-4260-4bcd-b068-e4eeb9204e0b tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-92f2b59d-4673-4871-a193-b9c8d8642737-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:55 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 0 in 0.895s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c223e7fa-335f-4690-8d1c-349d8cc0aad3_u6ks76sldevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:19:55 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Converted 112.00 MB image at 112.00 MB/s Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:55 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b 1G Apr 13 14:19:55 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:55 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:55 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info is being set with open permissions: ugo+rw Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:55 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info Apr 13 14:19:55 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:55 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:55 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196 Apr 13 14:19:55 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:55 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b 1G" returned: 0 in 0.447s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f2576-827c-419f-ba40-d1217268fbbd]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:56 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:19:56 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:56 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.info" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:56 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e62905fb-7f3c-42de-b0ee-4eac0bb4136e tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Create snapshot completed successfully Apr 13 14:19:56 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-291e5208-4243-4622-8667-4a8e5b915196" returned: 0 in 0.431s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-quobyte-291e5208-4243-4622-8667-4a8e5b915196" released by "delete_volume" :: held 1.001s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Created reservations ['40fd1868-3478-4b22-a1a8-d92fd1e15127', '5ccacc95-b6c8-4784-9674-8c2f72a461b1', '1f22b93e-5278-42f4-abb0-dac19bb60aa8', 'c2080a6d-6f8a-41ef-a226-d8028597bba2'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:56 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:19:56 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:56 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:56 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:19:56 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:56 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "cinder-45693e21-3c77-4b97-8452-e575eb9c8b61-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:56 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Deleted volume successfully. Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4ab2997f-9ba9-4231-a9a0-277c89890cd6 tempest-VolumesDeleteCascade-412500601 None] Lock "cinder-291e5208-4243-4622-8667-4a8e5b915196-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-45693e21-3c77-4b97-8452-e575eb9c8b61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "cinder-quobyte-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-quobyte-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "cinder-quobyte-45693e21-3c77-4b97-8452-e575eb9c8b61" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-quobyte-45693e21-3c77-4b97-8452-e575eb9c8b61" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Deleting offline snapshot 45693e21-3c77-4b97-8452-e575eb9c8b61 of volume 6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] snapshot_file for this snap is: volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c8b74c-d037-49bb-81e4-97c25c41107d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:56 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 Apr 13 14:19:56 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:56 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 1 in 0.481s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Downloaded image c223e7fa-335f-4690-8d1c-349d8cc0aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}])) to volume f8771da4-5460-4187-8a99-b263ceca129b successfully. {{(pid=82621) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Temporary image c223e7fa-335f-4690-8d1c-349d8cc0aad3 for user 31d7b7332eed44c7927b21273dc2b690 is deleted. {{(pid=82621) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.volume_utils [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Marking volume f8771da4-5460-4187-8a99-b263ceca129b as bootable. {{(pid=82621) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Copying metadata from image c223e7fa-335f-4690-8d1c-349d8cc0aad3 to f8771da4-5460-4187-8a99-b263ceca129b. {{(pid=82621) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Creating volume glance metadata for volume f8771da4-5460-4187-8a99-b263ceca129b backed by image c223e7fa-335f-4690-8d1c-349d8cc0aad3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82621) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 14:19:56 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c291c513-b4e5-4ed0-9982-8a21f9b57c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8771da4-5460-4187-8a99-b263ceca129b', 'volume_size': 1, 'image_id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3a947e3eb764749990f4c7ab4025bff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c223e7fa-335f-4690-8d1c-349d8cc0aad3', 'created_at': datetime.datetime(2026, 4, 13, 12, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 12, 9, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c223e7fa-335f-4690-8d1c-349d8cc0aad3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b3c560-915d-40ed-bae1-bf773f3f578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:57 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Volume volume-f8771da4-5460-4187-8a99-b263ceca129b (f8771da4-5460-4187-8a99-b263ceca129b): created successfully Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b3c560-915d-40ed-bae1-bf773f3f578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (db8a8f99-81d3-468e-becf-ae4ef4f5264b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-aa82dad8-52ec-45a6-b285-45432c2fb23e tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:57 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f481b7-6b9f-4854-8bf3-7df2d4fd23eb]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:57 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 Apr 13 14:19:57 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:57 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:57 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 Apr 13 14:19:57 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:58 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61" returned: 0 in 0.555s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:58 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61 Apr 13 14:19:58 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (33a9cca8-d0a8-4c15-8c4a-940fa939f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fa41dd-7947-4b29-8b8c-e86390d3b37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fa41dd-7947-4b29-8b8c-e86390d3b37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-86683304',display_name='tempest-VolumesGetTest-Volume-72444487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced39463-4048-440e-b557-8c5bbdfc5945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:58Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d71b30e-2bc4-4422-87dd-450468280d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d71b30e-2bc4-4422-87dd-450468280d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36bf41b-4437-42ea-a444-198fb865c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36bf41b-4437-42ea-a444-198fb865c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced39463-4048-440e-b557-8c5bbdfc5945', 'volume_name': 'volume-ced39463-4048-440e-b557-8c5bbdfc5945', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e38cc-7915-4b24-a138-5321f10eeebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e38cc-7915-4b24-a138-5321f10eeebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6b869a-c905-476c-995d-2e452bd784aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:58 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Volume ced39463-4048-440e-b557-8c5bbdfc5945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced39463-4048-440e-b557-8c5bbdfc5945', 'volume_size': 1} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:19:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-86683304',display_name='tempest-VolumesGetTest-Volume-72444487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced39463-4048-440e-b557-8c5bbdfc5945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47af1826b50746fbba0455af5ab26244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:19:58Z,use_quota=True,user_id='31d7b7332eed44c7927b21273dc2b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Creating volume ced39463-4048-440e-b557-8c5bbdfc5945 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:19:58 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:58 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 1073741824 Apr 13 14:19:58 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:58 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6.45693e21-3c77-4b97-8452-e575eb9c8b61" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-quobyte-45693e21-3c77-4b97-8452-e575eb9c8b61" released by "_delete_snapshot" :: held 2.114s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-quobyte-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" released by "delete_snapshot" :: held 2.126s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:58 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Created reservations ['5ff75951-bede-41d1-9fd2-dc0b6bb79e25', 'efe025a0-23da-4f8f-aaa2-49f49ab01df2', '44e8dc71-31c5-45ea-a3a5-a42b2aeafb38', 'ac8ce3c3-74ed-47c9-84c0-0afec8763a33'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:19:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Delete snapshot completed successfully. Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d0c2799e-1371-455d-8631-3d51382aaa87 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-45693e21-3c77-4b97-8452-e575eb9c8b61-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:19:59 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 1073741824" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:19:59 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 Apr 13 14:19:59 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:19:59 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945" returned: 0 in 0.441s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6b869a-c905-476c-995d-2e452bd784aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced39463-4048-440e-b557-8c5bbdfc5945', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b940c8f2-fe8d-4557-9f81-48e4950baace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:19:59 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Volume volume-ced39463-4048-440e-b557-8c5bbdfc5945 (ced39463-4048-440e-b557-8c5bbdfc5945): created successfully Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b940c8f2-fe8d-4557-9f81-48e4950baace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Flow 'volume_create_manager' (33a9cca8-d0a8-4c15-8c4a-940fa939f95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:19:59 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ee088d1d-c489-4426-a8dd-08c832549352 tempest-VolumesGetTest-1835127947 None] Created volume successfully. Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "cinder-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:19:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "cinder-quobyte-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-quobyte-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb9abf-806e-4202-908a-5630570e7e3e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:00 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 Apr 13 14:20:00 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:00 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" returned: 0 in 0.552s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-ced39463-4048-440e-b557-8c5bbdfc5945-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:00 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6 Apr 13 14:20:00 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Lock "cinder-ced39463-4048-440e-b557-8c5bbdfc5945-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-ced39463-4048-440e-b557-8c5bbdfc5945" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-ced39463-4048-440e-b557-8c5bbdfc5945" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1e76a8-1b82-4784-95df-d7e3da6e4fa4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:00 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 Apr 13 14:20:00 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:01 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" returned: 0 in 0.473s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-quobyte-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6" released by "delete_volume" :: held 1.054s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Created reservations ['6508cd2f-c32b-48ba-9ae9-79bd49799b5a', 'b02801a3-d080-4c38-8013-56a22e059823', 'febf91c0-e6d7-40f1-ba82-b07e0970dba9', '1f4609a3-f4d6-42f4-be22-3a15114b71e1'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:01 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:01 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:01 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945" returned: 0 in 0.571s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:01 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945 Apr 13 14:20:01 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:01 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.453s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Deleted volume successfully. Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-add3f071-d121-41e6-b1d4-70828b3771d5 tempest-VolumesSnapshotNegativeTestJSON-1387791893 None] Lock "cinder-6c3b99c1-e2a8-4177-9e8a-cb57cf1740a6-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:01 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ced39463-4048-440e-b557-8c5bbdfc5945" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-ced39463-4048-440e-b557-8c5bbdfc5945" released by "delete_volume" :: held 0.993s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Created reservations ['c6868a14-53fa-4f1d-8f69-767a52c5c070', '8f8f9dba-5e44-4991-80ec-99bfff530af8', '5d80ab90-df7c-439d-a7de-efad067d1a58', '8b1d257e-4929-43c1-a347-b747109af7f6'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:01 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:01 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:02 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.523s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f8f0c2b4-4da0-4ede-a176-d625d4bd44df tempest-VolumesGetTest-1835127947 None] Lock "cinder-ced39463-4048-440e-b557-8c5bbdfc5945-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-f8771da4-5460-4187-8a99-b263ceca129b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Lock "cinder-f8771da4-5460-4187-8a99-b263ceca129b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Acquiring lock "cinder-quobyte-f8771da4-5460-4187-8a99-b263ceca129b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-f8771da4-5460-4187-8a99-b263ceca129b" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0214439e-3f3b-40e0-9567-38fcb1fbefea]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:03 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:20:03 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:03 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 0 in 0.665s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:03 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:20:03 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:04 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 1 in 0.583s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:04 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b Apr 13 14:20:04 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:04 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f8771da4-5460-4187-8a99-b263ceca129b" returned: 0 in 0.539s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Lock "cinder-quobyte-f8771da4-5460-4187-8a99-b263ceca129b" released by "delete_volume" :: held 1.844s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Created reservations ['fe289e07-67ca-40bf-b743-5f25ca1ab7c7', 'dae027cd-0206-4019-bc3c-0ea62e4496cd', '00cdea31-6b76-4c8d-bdad-7736c06c02cf', 'ac21026c-5d49-4d8c-b66b-4eface9bcf49'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:04 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:04 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Flow 'volume_create_manager' (b03c5ac4-7ead-41ff-a85d-2c7680d7faf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094afead-4d93-492b-8071-3d9fd0fc967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094afead-4d93-492b-8071-3d9fd0fc967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1423963627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f75bf5f-22c5-4909-b59d-3d8e68bb7511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2780c3aa11274b8db2defd912aeb7ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:05Z,use_quota=True,user_id='e50a0d604a7a412fa4dc0868de6e3331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fed95c-8298-43ac-8351-3b8f36fa1fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0fed95c-8298-43ac-8351-3b8f36fa1fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aee78f0-2226-4491-9d42-5c04344965f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aee78f0-2226-4491-9d42-5c04344965f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f75bf5f-22c5-4909-b59d-3d8e68bb7511', 'volume_name': 'volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdd6291-a2f2-4e11-8ddc-97ab68a9d196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdd6291-a2f2-4e11-8ddc-97ab68a9d196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bb87cd-e512-47ee-af93-fbe273629831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:05 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Volume 4f75bf5f-22c5-4909-b59d-3d8e68bb7511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511', 'volume_size': 1} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1423963627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f75bf5f-22c5-4909-b59d-3d8e68bb7511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2780c3aa11274b8db2defd912aeb7ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:05Z,use_quota=True,user_id='e50a0d604a7a412fa4dc0868de6e3331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Creating volume 4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:05 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:05 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 1073741824 Apr 13 14:20:05 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:05 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.588s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:05 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Deleted volume successfully. Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-89950fc7-fc7f-4b42-bde9-cbe79a0dfe88 tempest-VolumesGetTest-1835127947 None] Lock "cinder-f8771da4-5460-4187-8a99-b263ceca129b-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:05 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 1073741824" returned: 0 in 0.596s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:05 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:20:05 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:06 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.447s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bb87cd-e512-47ee-af93-fbe273629831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce331a5-7243-44f7-b941-11fefa73c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:06 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Volume volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 (4f75bf5f-22c5-4909-b59d-3d8e68bb7511): created successfully Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce331a5-7243-44f7-b941-11fefa73c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Flow 'volume_create_manager' (b03c5ac4-7ead-41ff-a85d-2c7680d7faf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-45c2481b-dcc9-48b6-bfb3-78925e52db91 tempest-VolumesActionsTest-342559379 None] Created volume successfully. Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (9a5fb5d1-d9a5-4df7-a764-8edd5b47fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1a0c6f-a0da-453d-b05f-e8e120d7684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1a0c6f-a0da-453d-b05f-e8e120d7684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162963277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3332284-9e57-4eaf-ab73-32bc6c293fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:07Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9050fa-a5e8-4a38-b05e-178d0e7c4f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9050fa-a5e8-4a38-b05e-178d0e7c4f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edbdce1-399c-4979-aab1-fc4efd116159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edbdce1-399c-4979-aab1-fc4efd116159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3332284-9e57-4eaf-ab73-32bc6c293fa7', 'volume_name': 'volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df00944b-ee32-4f77-8d7b-0d24b42d4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df00944b-ee32-4f77-8d7b-0d24b42d4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a472bd-3df5-4e6b-b7a4-e45a4fc60230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:07 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume f3332284-9e57-4eaf-ab73-32bc6c293fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7', 'volume_size': 1} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162963277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3332284-9e57-4eaf-ab73-32bc6c293fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:07Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating volume f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:07 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:07 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 1073741824 Apr 13 14:20:07 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:07 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 1073741824" returned: 0 in 0.516s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:07 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 Apr 13 14:20:07 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:08 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a472bd-3df5-4e6b-b7a4-e45a4fc60230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e55cc01-4885-4265-93bd-c242bb8b4cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 (f3332284-9e57-4eaf-ab73-32bc6c293fa7): created successfully Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e55cc01-4885-4265-93bd-c242bb8b4cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (9a5fb5d1-d9a5-4df7-a764-8edd5b47fecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:08 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-82c05db2-826b-46b5-903b-9a6b8a34086f tempest-CreateVolumesFromSnapshotTest-559296048 None] Created volume successfully. Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating offline snapshot 3e498b51-2ae9-4e36-ab83-c2aeb8d94937 of volume f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ba2df8-6f55-46b9-a9b1-c6d6cd373793]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:09 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 Apr 13 14:20:09 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:09 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:09 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 1G Apr 13 14:20:09 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:10 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 1G" returned: 0 in 0.477s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:10 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 Apr 13 14:20:10 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:10 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937" returned: 0 in 0.442s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:10 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 is being set with open permissions: ugo+rw Apr 13 14:20:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:10 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 Apr 13 14:20:10 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:11 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937" returned: 0 in 0.432s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:11 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info Apr 13 14:20:11 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:11 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info" returned: 0 in 0.416s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:11 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info is being set with open permissions: ugo+rw Apr 13 14:20:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:11 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info Apr 13 14:20:11 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:12 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.info" returned: 0 in 0.389s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b349d0fa-912f-4855-b28a-206acfb9ee2e tempest-CreateVolumesFromSnapshotTest-559296048 None] Create snapshot completed successfully Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (ee989076-b563-4020-8ca4-16dfa405957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d09e3af-7741-4ffe-81d2-ae46c6a66e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d09e3af-7741-4ffe-81d2-ae46c6a66e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-562575340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab85373a-55ab-4a4b-adc9-3141bfa6198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab85373a-55ab-4a4b-adc9-3141bfa6198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d627426e-0a60-4017-9b8a-0f87ed707302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d627426e-0a60-4017-9b8a-0f87ed707302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2', 'volume_name': 'volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c22ccf0-cabc-4301-8a5d-6bc0a0828cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c22ccf0-cabc-4301-8a5d-6bc0a0828cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6f2897-cae3-4cd4-81c5-85b9db653888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:12 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2', 'volume_size': 1} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-562575340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating volume e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:12 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:12 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 1073741824 Apr 13 14:20:12 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (7f1f7bd6-a874-4c57-97ab-a61d9bc6ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176f8521-deea-4f12-a2ff-8e081c2bcd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176f8521-deea-4f12-a2ff-8e081c2bcd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313620694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f212265-78df-41ff-8fb7-c80ed68253d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7be3551-d2ca-4817-956b-14a5ef2bb411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7be3551-d2ca-4817-956b-14a5ef2bb411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32e7567-f5c9-4360-9296-a18629b7e20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32e7567-f5c9-4360-9296-a18629b7e20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f212265-78df-41ff-8fb7-c80ed68253d1', 'volume_name': 'volume-2f212265-78df-41ff-8fb7-c80ed68253d1', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d456ec9b-7ba9-4338-9697-3d87424dbba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d456ec9b-7ba9-4338-9697-3d87424dbba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8468b3a2-4f39-4103-98c6-5629e9039f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume 2f212265-78df-41ff-8fb7-c80ed68253d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f212265-78df-41ff-8fb7-c80ed68253d1', 'volume_size': 1} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (cf6dfeab-48ab-480a-9b32-9d3c66628b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f165568e-1e8b-424b-ac53-5c7bc137a8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f165568e-1e8b-424b-ac53-5c7bc137a8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493299233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffe271f-acf5-4faf-873d-d1c697e34e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1033bb-c4a3-46f8-ab1a-23cbf5bcd727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1033bb-c4a3-46f8-ab1a-23cbf5bcd727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d0275f-655b-40f1-8bbd-84c8328d5d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d0275f-655b-40f1-8bbd-84c8328d5d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffe271f-acf5-4faf-873d-d1c697e34e8e', 'volume_name': 'volume-dffe271f-acf5-4faf-873d-d1c697e34e8e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0acc66e-803a-4d79-b222-b077c15d9d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0acc66e-803a-4d79-b222-b077c15d9d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd63f12f-7dd0-426e-841b-69ccea327c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume dffe271f-acf5-4faf-873d-d1c697e34e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffe271f-acf5-4faf-873d-d1c697e34e8e', 'volume_size': 1} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:13 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (43ffc2c1-3f24-4144-97a3-f903467c6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d231c7-9367-482b-a17c-c59dbac6bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 1073741824" returned: 0 in 0.691s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d231c7-9367-482b-a17c-c59dbac6bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700540655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aac888f-e845-401c-aa24-4ee8893ad379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18758784-1490-426a-b5a7-a4c2f2298b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18758784-1490-426a-b5a7-a4c2f2298b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95a2db6-5aad-401c-a310-49f9546f1067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95a2db6-5aad-401c-a310-49f9546f1067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aac888f-e845-401c-aa24-4ee8893ad379', 'volume_name': 'volume-1aac888f-e845-401c-aa24-4ee8893ad379', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1565e83-6a96-444f-9ed9-82d16c7c0872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1565e83-6a96-444f-9ed9-82d16c7c0872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e865e6-6cb2-4c3f-aa22-574560b9d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume 1aac888f-e845-401c-aa24-4ee8893ad379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aac888f-e845-401c-aa24-4ee8893ad379', 'volume_size': 1} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:13 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 Apr 13 14:20:13 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (0a6885f6-be8b-401c-a888-32ab460f62c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365f8be9-57b6-4c3f-9c9c-0586ac9a4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365f8be9-57b6-4c3f-9c9c-0586ac9a4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245904948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f17891-b049-452e-b603-db97cd2a2881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:14Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d132c332-83ae-4383-8963-09733a4d3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d132c332-83ae-4383-8963-09733a4d3481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc3edad-103f-4965-b0cd-dd692d7cbe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc3edad-103f-4965-b0cd-dd692d7cbe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f17891-b049-452e-b603-db97cd2a2881', 'volume_name': 'volume-a4f17891-b049-452e-b603-db97cd2a2881', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d3c6e1-d858-4f7b-8c9d-9de11febf61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d3c6e1-d858-4f7b-8c9d-9de11febf61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb531f5-f853-4a14-b863-746cd3901609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume a4f17891-b049-452e-b603-db97cd2a2881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f17891-b049-452e-b603-db97cd2a2881', 'volume_size': 1} Apr 13 14:20:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:14 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2" returned: 0 in 0.504s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313620694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f212265-78df-41ff-8fb7-c80ed68253d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating volume 2f212265-78df-41ff-8fb7-c80ed68253d1 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:14 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6f2897-cae3-4cd4-81c5-85b9db653888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2e8317-c56b-4d49-942b-cf13b877852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:14 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 1073741824 Apr 13 14:20:14 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:14 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 (e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2): created successfully Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2e8317-c56b-4d49-942b-cf13b877852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (ee989076-b563-4020-8ca4-16dfa405957c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:14 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d38d8912-c65e-40c5-ae25-234193ae09e0 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created volume successfully. Apr 13 14:20:14 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 1073741824" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:14 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 Apr 13 14:20:14 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:15 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1" returned: 0 in 0.439s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493299233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffe271f-acf5-4faf-873d-d1c697e34e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating volume dffe271f-acf5-4faf-873d-d1c697e34e8e {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:15 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8468b3a2-4f39-4103-98c6-5629e9039f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f212265-78df-41ff-8fb7-c80ed68253d1', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d82571-a3b7-44b5-870f-14c614ed99af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:15 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e 1073741824 Apr 13 14:20:15 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:15 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume volume-2f212265-78df-41ff-8fb7-c80ed68253d1 (2f212265-78df-41ff-8fb7-c80ed68253d1): created successfully Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d82571-a3b7-44b5-870f-14c614ed99af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (7f1f7bd6-a874-4c57-97ab-a61d9bc6ac65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1b04612f-791b-424f-83fc-2f2ce548f365 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created volume successfully. Apr 13 14:20:15 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e 1073741824" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:15 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e Apr 13 14:20:15 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:16 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e" returned: 0 in 0.433s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.438s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700540655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aac888f-e845-401c-aa24-4ee8893ad379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:13Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating volume 1aac888f-e845-401c-aa24-4ee8893ad379 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:16 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd63f12f-7dd0-426e-841b-69ccea327c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffe271f-acf5-4faf-873d-d1c697e34e8e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5bfb2-5995-4d1b-aaec-24a21e8682e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:16 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 1073741824 Apr 13 14:20:16 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:16 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume volume-dffe271f-acf5-4faf-873d-d1c697e34e8e (dffe271f-acf5-4faf-873d-d1c697e34e8e): created successfully Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5bfb2-5995-4d1b-aaec-24a21e8682e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (cf6dfeab-48ab-480a-9b32-9d3c66628b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-feaccde8-e713-4b69-9c25-face6f07e7b6 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created volume successfully. Apr 13 14:20:16 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 1073741824" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:16 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 Apr 13 14:20:16 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:17 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379" returned: 0 in 0.492s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.251s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245904948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f17891-b049-452e-b603-db97cd2a2881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2363c3e05a234f41ae97a49b3590d405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:14Z,use_quota=True,user_id='5de287f0eb5141d388777e453f18e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Creating volume a4f17891-b049-452e-b603-db97cd2a2881 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:17 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e865e6-6cb2-4c3f-aa22-574560b9d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aac888f-e845-401c-aa24-4ee8893ad379', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5196f7-f3d4-45c8-931a-79838e9e1e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:17 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 1073741824 Apr 13 14:20:17 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume volume-1aac888f-e845-401c-aa24-4ee8893ad379 (1aac888f-e845-401c-aa24-4ee8893ad379): created successfully Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5196f7-f3d4-45c8-931a-79838e9e1e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (43ffc2c1-3f24-4144-97a3-f903467c6d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:17 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5ef2e446-7c65-44d2-970c-a3b63ddfacb7 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created volume successfully. Apr 13 14:20:17 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 1073741824" returned: 0 in 0.493s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:17 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 Apr 13 14:20:17 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:17 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb531f5-f853-4a14-b863-746cd3901609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f17891-b049-452e-b603-db97cd2a2881', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1300e5-f259-4a2c-9cff-21079cdef9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Volume volume-a4f17891-b049-452e-b603-db97cd2a2881 (a4f17891-b049-452e-b603-db97cd2a2881): created successfully Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1300e5-f259-4a2c-9cff-21079cdef9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Flow 'volume_create_manager' (0a6885f6-be8b-401c-a888-32ab460f62c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:17 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4f6855d8-79d0-494a-ac2d-560a2e53c499 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created volume successfully. Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-a4f17891-b049-452e-b603-db97cd2a2881-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-a4f17891-b049-452e-b603-db97cd2a2881-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-a4f17891-b049-452e-b603-db97cd2a2881" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-a4f17891-b049-452e-b603-db97cd2a2881" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec67081-ffe5-48d4-8a9b-cca9908d879b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:18 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 Apr 13 14:20:18 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:18 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881" returned: 0 in 0.593s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:18 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881 Apr 13 14:20:18 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:19 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-a4f17891-b049-452e-b603-db97cd2a2881" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-a4f17891-b049-452e-b603-db97cd2a2881" released by "delete_volume" :: held 1.129s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['1e9dc43b-6638-4713-a8c9-16757133a6a3', 'd7b43e73-6e07-4b44-9696-770a26a9b430', '7c873b44-eaab-4b44-b93d-3259b196cb7f', '9b843b70-904d-44ab-88c5-1500639c23a5'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:19 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:19 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:19 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:19 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:19 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.438s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleted volume successfully. Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4cf6463e-cb92-4367-96fb-90fd28de5dc5 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-a4f17891-b049-452e-b603-db97cd2a2881-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:19 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.423s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-1aac888f-e845-401c-aa24-4ee8893ad379-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-1aac888f-e845-401c-aa24-4ee8893ad379-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-1aac888f-e845-401c-aa24-4ee8893ad379" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-1aac888f-e845-401c-aa24-4ee8893ad379" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d20fc-b30a-479d-a6dc-170f4918421a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:20 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 Apr 13 14:20:20 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2a3c745c-875a-4617-9daf-4ed97639c9ca tempest-VolumesActionsTest-342559379 None] Acquiring lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" by "attach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2a3c745c-875a-4617-9daf-4ed97639c9ca tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" acquired by "attach_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2a3c745c-875a-4617-9daf-4ed97639c9ca tempest-VolumesActionsTest-342559379 None] Attaching volume 4f75bf5f-22c5-4909-b59d-3d8e68bb7511 to instance 265add5b-b72d-46af-be31-6134cd2727d5 at mountpoint /dev/vdb on host None. Apr 13 14:20:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2a3c745c-875a-4617-9daf-4ed97639c9ca tempest-VolumesActionsTest-342559379 None] Attach volume completed successfully. Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-2a3c745c-875a-4617-9daf-4ed97639c9ca tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" released by "attach_volume" :: held 0.073s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:20 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379" returned: 0 in 0.529s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:20 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379 Apr 13 14:20:20 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:21 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-1aac888f-e845-401c-aa24-4ee8893ad379" returned: 0 in 0.405s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-1aac888f-e845-401c-aa24-4ee8893ad379" released by "delete_volume" :: held 0.960s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['9292311b-da7c-48b8-9351-009efb669bb8', 'd8a2ff08-ee83-429d-966b-5898bd7ffd96', 'f672dadd-8c95-4836-a7df-695360da7fc9', '24eab70c-abea-405c-8317-07ef57fb79c3'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-732bc7ea-7cf9-4d6c-8687-39291c59aa91 tempest-VolumesActionsTest-342559379 None] Acquiring lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-detach_volume" by "detach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-732bc7ea-7cf9-4d6c-8687-39291c59aa91 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-732bc7ea-7cf9-4d6c-8687-39291c59aa91 tempest-VolumesActionsTest-342559379 None] Detaching volume 4f75bf5f-22c5-4909-b59d-3d8e68bb7511 from instance 265add5b-b72d-46af-be31-6134cd2727d5. Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:21 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:21 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-732bc7ea-7cf9-4d6c-8687-39291c59aa91 tempest-VolumesActionsTest-342559379 None] Detach volume completed successfully. Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-732bc7ea-7cf9-4d6c-8687-39291c59aa91 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:21 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.398s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleted volume successfully. Apr 13 14:20:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-612ccab4-2827-4904-8caf-540371edf753 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-1aac888f-e845-401c-aa24-4ee8893ad379-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-dffe271f-acf5-4faf-873d-d1c697e34e8e-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-dffe271f-acf5-4faf-873d-d1c697e34e8e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-dffe271f-acf5-4faf-873d-d1c697e34e8e" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-dffe271f-acf5-4faf-873d-d1c697e34e8e" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b9605c-098a-454a-a419-38fc1383acee]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:22 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e Apr 13 14:20:22 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:23 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e" returned: 0 in 0.473s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:23 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e Apr 13 14:20:23 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:23 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-dffe271f-acf5-4faf-873d-d1c697e34e8e" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-dffe271f-acf5-4faf-873d-d1c697e34e8e" released by "delete_volume" :: held 1.027s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['5a2d8b4c-049c-404d-872d-9e0e152c054a', '2209377c-5354-42ba-b5c5-380441e333c3', 'd64d4d2d-80c4-4a6a-9c7c-e37d8596c85a', '756b3c5c-e39b-4033-8fde-fa2672ca8534'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:23 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:23 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:24 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.421s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:24 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleted volume successfully. Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-693d042e-b93b-4b1d-9758-443ac1e5ca8c tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-dffe271f-acf5-4faf-873d-d1c697e34e8e-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-2f212265-78df-41ff-8fb7-c80ed68253d1-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-2f212265-78df-41ff-8fb7-c80ed68253d1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-2f212265-78df-41ff-8fb7-c80ed68253d1" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-2f212265-78df-41ff-8fb7-c80ed68253d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a152709-6e0d-4647-ae1e-a9af9b03b2b0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:24 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 Apr 13 14:20:24 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:25 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:25 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1 Apr 13 14:20:25 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:25 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2f212265-78df-41ff-8fb7-c80ed68253d1" returned: 0 in 0.395s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-2f212265-78df-41ff-8fb7-c80ed68253d1" released by "delete_volume" :: held 0.874s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['69bf64ff-444a-46e2-a2df-d76c8ba5dd0f', 'a52d66b8-c8fa-4430-ac13-0699a060282c', '95e5a63b-bce0-4d92-bb0f-4887f8f9e45d', '48fb5274-973b-4858-b57a-5f499949caa5'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:25 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:25 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2" acquired by "delete_volume" :: waited 0.020s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec989b2-0960-4a6e-973d-80480f6863af]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:25 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 Apr 13 14:20:25 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:26 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.430s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:26 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleted volume successfully. Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-acf514e9-76c2-4a2f-beb1-93701f257ccc tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-2f212265-78df-41ff-8fb7-c80ed68253d1-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:26 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2" returned: 0 in 0.483s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:26 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2 Apr 13 14:20:26 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:26 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2" released by "delete_volume" :: held 0.904s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['e7706d37-c67c-4e29-89c1-1d33cafbbfe4', 'f30816ac-fbd7-4e72-98d3-f5751309d889', '5db89d51-603d-412e-97ed-a27944247eb0', 'cb0475a3-082f-4392-8a1b-f0cc753e3f71'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:26 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:26 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:27 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.411s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:27 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleted volume successfully. Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0375ad97-7c46-4efa-bd86-bc44156319fe tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-e02fbc1a-e0ff-44e1-a875-bdbf2f63f6e2-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-3e498b51-2ae9-4e36-ab83-c2aeb8d94937-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-3e498b51-2ae9-4e36-ab83-c2aeb8d94937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-f3332284-9e57-4eaf-ab73-32bc6c293fa7" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-f3332284-9e57-4eaf-ab73-32bc6c293fa7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-3e498b51-2ae9-4e36-ab83-c2aeb8d94937" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-3e498b51-2ae9-4e36-ab83-c2aeb8d94937" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleting offline snapshot 3e498b51-2ae9-4e36-ab83-c2aeb8d94937 of volume f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] snapshot_file for this snap is: volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7073ef4f-6347-4cf6-acda-206cebdd6dd8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:28 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 Apr 13 14:20:28 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:28 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c240587f-282e-4513-b588-2707c15d1eb2]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:28 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 Apr 13 14:20:28 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:28 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7" returned: 0 in 0.459s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:28 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 Apr 13 14:20:28 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:29 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937" returned: 0 in 0.510s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:29 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937 Apr 13 14:20:29 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:29 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7.3e498b51-2ae9-4e36-ab83-c2aeb8d94937" returned: 0 in 0.439s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-3e498b51-2ae9-4e36-ab83-c2aeb8d94937" released by "_delete_snapshot" :: held 1.927s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-f3332284-9e57-4eaf-ab73-32bc6c293fa7" released by "delete_snapshot" :: held 1.941s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:29 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['a73212a9-b8b7-42a4-a244-6af25eedd080', 'c8573460-ae3c-411e-9653-d56b7f888f1a', '6fe6db29-6da4-43f3-9cdd-b03d6d83ae01', '7b8ea34d-8075-49f4-bcdf-6acb4e82f81d'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:30 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Delete snapshot completed successfully. Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d29fb2ec-2dd3-40a5-80e3-4781a613b678 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-3e498b51-2ae9-4e36-ab83-c2aeb8d94937-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-f3332284-9e57-4eaf-ab73-32bc6c293fa7-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-f3332284-9e57-4eaf-ab73-32bc6c293fa7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "cinder-quobyte-f3332284-9e57-4eaf-ab73-32bc6c293fa7" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-f3332284-9e57-4eaf-ab73-32bc6c293fa7" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[576145b4-79ed-4d69-8be4-e68dbfd6bbdc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:30 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 Apr 13 14:20:30 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:30 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7" returned: 0 in 0.503s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:30 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7 Apr 13 14:20:30 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:31 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-f3332284-9e57-4eaf-ab73-32bc6c293fa7" returned: 0 in 0.424s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-quobyte-f3332284-9e57-4eaf-ab73-32bc6c293fa7" released by "delete_volume" :: held 0.962s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Created reservations ['52252202-c971-4c6b-a472-986fcd2b8dab', '7b658cf9-6e78-4043-8810-4e1a0748b856', 'ea811094-f15a-425e-a6fc-c9012ba5f141', '751c0f1d-d4b3-48cc-9a87-ea12687de346'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:31 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:31 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:31 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.475s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:31 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Deleted volume successfully. Apr 13 14:20:31 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e891c0da-19d9-45b0-8972-a1d844f938a8 tempest-CreateVolumesFromSnapshotTest-559296048 None] Lock "cinder-f3332284-9e57-4eaf-ab73-32bc6c293fa7-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Flow 'volume_create_manager' (d0d58816-5fd3-47b6-a1db-6b0c4884907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70477bef-5ef2-473d-bf63-25e6c4919574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70477bef-5ef2-473d-bf63-25e6c4919574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e4c177d50b46f1b7874a680efeaf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:33Z,use_quota=True,user_id='f8426129cb3046e4a4d65512554bf111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdc933f-9755-4406-8d23-e56914881f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdc933f-9755-4406-8d23-e56914881f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3bdb45-2e5b-4f49-a7b6-065d4a888216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3bdb45-2e5b-4f49-a7b6-065d4a888216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a', 'volume_name': 'volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcb6123-8205-4009-bf05-b1a22937c252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcb6123-8205-4009-bf05-b1a22937c252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b7395-0c92-4e07-adb5-a2f528896390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:33 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Volume 9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a', 'volume_size': 1} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e4c177d50b46f1b7874a680efeaf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:33Z,use_quota=True,user_id='f8426129cb3046e4a4d65512554bf111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Creating volume 9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:33 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:33 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a 1073741824 Apr 13 14:20:33 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:33 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a 1073741824" returned: 0 in 0.482s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:33 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a Apr 13 14:20:33 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:34 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b7395-0c92-4e07-adb5-a2f528896390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43a1156-b2ea-48c3-b4a1-6bb3933b51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:34 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Volume volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a (9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a): created successfully Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43a1156-b2ea-48c3-b4a1-6bb3933b51af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:34 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Flow 'volume_create_manager' (d0d58816-5fd3-47b6-a1db-6b0c4884907c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:34 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-10cc112d-9f2b-44f0-8eb2-bf1043654ba2 tempest-CinderUnicodeTest-2058840243 None] Created volume successfully. Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Flow 'volume_create_manager' (b70568cf-b153-497d-a1da-831e3f87141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b4601f-e14d-442c-9838-83272d089e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b4601f-e14d-442c-9838-83272d089e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1532633736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76174b5-7bf2-40ec-880c-e366f1cf0cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e4c177d50b46f1b7874a680efeaf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:36Z,use_quota=True,user_id='f8426129cb3046e4a4d65512554bf111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4001e-c866-4b83-a440-38c081ad2cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4001e-c866-4b83-a440-38c081ad2cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240762b3-f11b-494a-a164-53cfeb5ace36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240762b3-f11b-494a-a164-53cfeb5ace36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76174b5-7bf2-40ec-880c-e366f1cf0cb7', 'volume_name': 'volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc151b3-4f37-4855-8812-d4e10cdf327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc151b3-4f37-4855-8812-d4e10cdf327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f921fd7-7ba6-4496-9937-ed583be91f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:35 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Volume d76174b5-7bf2-40ec-880c-e366f1cf0cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7', 'volume_size': 1} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:20:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1532633736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76174b5-7bf2-40ec-880c-e366f1cf0cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e4c177d50b46f1b7874a680efeaf9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:20:36Z,use_quota=True,user_id='f8426129cb3046e4a4d65512554bf111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Creating volume d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:20:35 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:20:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:35 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 1073741824 Apr 13 14:20:35 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:36 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 1073741824" returned: 0 in 0.564s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:36 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 Apr 13 14:20:36 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:36 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" returned: 0 in 0.389s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f921fd7-7ba6-4496-9937-ed583be91f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97eb39e-e74c-4421-ab79-c606fd5f684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:20:36 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Volume volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 (d76174b5-7bf2-40ec-880c-e366f1cf0cb7): created successfully Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97eb39e-e74c-4421-ab79-c606fd5f684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:20:36 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Flow 'volume_create_manager' (b70568cf-b153-497d-a1da-831e3f87141a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:20:36 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e4d9c658-caea-4965-9cb6-b08462b69660 tempest-CinderUnicodeTest-2058840243 None] Created volume successfully. Apr 13 14:20:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Creating offline snapshot 59aa869f-9f2a-441b-bb6f-5a156bcd8622 of volume d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:20:37 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c7b0d-5464-490c-9507-94ea7276ffec]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:37 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 Apr 13 14:20:37 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:38 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:38 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 1G Apr 13 14:20:38 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:38 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 1G" returned: 0 in 0.491s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:38 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 Apr 13 14:20:38 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:39 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622" returned: 0 in 0.419s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:39 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 is being set with open permissions: ugo+rw Apr 13 14:20:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:39 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 Apr 13 14:20:39 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:39 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622" returned: 0 in 0.530s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=164,cinder:UPDATE=204,cinder:INSERT=65,cinder:DELETE=18 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:20:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=216,cinder:DELETE=19,cinder:SELECT=155,cinder:INSERT=49 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:20:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:39 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info Apr 13 14:20:39 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:40 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info" returned: 0 in 0.496s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:40 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info is being set with open permissions: ugo+rw Apr 13 14:20:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:40 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info Apr 13 14:20:40 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:40 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.info" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:40 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:40 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3bcc8454-02db-4938-8339-1df21535caac tempest-CinderUnicodeTest-2058840243 None] Create snapshot completed successfully Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-59aa869f-9f2a-441b-bb6f-5a156bcd8622-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-59aa869f-9f2a-441b-bb6f-5a156bcd8622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-quobyte-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-quobyte-59aa869f-9f2a-441b-bb6f-5a156bcd8622" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-59aa869f-9f2a-441b-bb6f-5a156bcd8622" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Deleting offline snapshot 59aa869f-9f2a-441b-bb6f-5a156bcd8622 of volume d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] snapshot_file for this snap is: volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[796fd51f-70e6-4a8d-83d8-355eec0b1638]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:41 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 Apr 13 14:20:41 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:41 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622" returned: 0 in 0.527s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f54c5-6d31-41f9-8ea8-d141941c41aa]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:41 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 Apr 13 14:20:41 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:42 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" returned: 0 in 0.517s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:42 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 Apr 13 14:20:42 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1bec9cc1-5afd-4e05-b343-58b844dbff60 tempest-VolumesActionsTest-342559379 None] Acquiring lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" by "attach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1bec9cc1-5afd-4e05-b343-58b844dbff60 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" acquired by "attach_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1bec9cc1-5afd-4e05-b343-58b844dbff60 tempest-VolumesActionsTest-342559379 None] Attaching volume 4f75bf5f-22c5-4909-b59d-3d8e68bb7511 to instance b33ede97-0d94-495b-83a0-188e5d1b11d7 at mountpoint /dev/vdb on host None. Apr 13 14:20:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1bec9cc1-5afd-4e05-b343-58b844dbff60 tempest-VolumesActionsTest-342559379 None] Attach volume completed successfully. Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1bec9cc1-5afd-4e05-b343-58b844dbff60 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" released by "attach_volume" :: held 0.056s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:42 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622" returned: 0 in 0.477s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:42 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622 Apr 13 14:20:42 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a70fef21-bcd7-4480-a921-7b2e1e23c4d8 tempest-VolumesActionsTest-342559379 None] Acquiring lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-detach_volume" by "detach_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a70fef21-bcd7-4480-a921-7b2e1e23c4d8 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a70fef21-bcd7-4480-a921-7b2e1e23c4d8 tempest-VolumesActionsTest-342559379 None] Detaching volume 4f75bf5f-22c5-4909-b59d-3d8e68bb7511 from instance b33ede97-0d94-495b-83a0-188e5d1b11d7. Apr 13 14:20:43 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7.59aa869f-9f2a-441b-bb6f-5a156bcd8622" returned: 0 in 0.443s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-a70fef21-bcd7-4480-a921-7b2e1e23c4d8 tempest-VolumesActionsTest-342559379 None] Detach volume completed successfully. Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-59aa869f-9f2a-441b-bb6f-5a156bcd8622" released by "_delete_snapshot" :: held 2.083s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-a70fef21-bcd7-4480-a921-7b2e1e23c4d8 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" released by "delete_snapshot" :: held 2.099s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Created reservations ['c2d34a59-0e78-45d8-a913-dec8a040de35', 'b1b479cd-8e38-4f86-ba2b-a29457ca3524', '193c5f71-e55d-42db-9ce4-e888e7c4f999', '552d8ef4-fbec-40cf-9301-1eb1df2c1e13'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Delete snapshot completed successfully. Apr 13 14:20:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-e186a0d7-3a1c-44af-abe2-ff000bbf1681 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-59aa869f-9f2a-441b-bb6f-5a156bcd8622-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-d76174b5-7bf2-40ec-880c-e366f1cf0cb7-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-d76174b5-7bf2-40ec-880c-e366f1cf0cb7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-quobyte-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26db87c-d7ea-4a23-9780-46c6a7241201]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:44 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 Apr 13 14:20:44 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:44 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:44 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7 Apr 13 14:20:44 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:45 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" returned: 0 in 0.522s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-d76174b5-7bf2-40ec-880c-e366f1cf0cb7" released by "delete_volume" :: held 1.082s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Created reservations ['1fb8306e-122b-4230-8d04-7764f0682d89', '60d79c87-0725-4cb6-8b69-4f7c0b7d93b7', '64f88897-6806-4a7a-8cfd-2337a78de532', '21712304-7eff-4be7-9977-b85be1311f14'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:45 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:45 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:45 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.445s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Deleted volume successfully. Apr 13 14:20:45 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-982d3134-0d00-4095-884b-1f293c651cc2 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-d76174b5-7bf2-40ec-880c-e366f1cf0cb7-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "cinder-quobyte-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:20:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:20:46 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca7f496-49f5-4ae0-9631-5f9c8e366f24]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:46 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a Apr 13 14:20:46 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:47 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:47 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a Apr 13 14:20:47 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:47 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-quobyte-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a" released by "delete_volume" :: held 0.939s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Created reservations ['cc6f3199-b78e-456f-a699-2aa88234f909', '6f5790de-a1d0-473c-a46a-e097c79515f5', 'fde9bd42-d12f-4c90-987b-114dfd364530', '58709b8d-52b5-41c5-b4c3-9bb196bef15f'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:20:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:47 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:20:47 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:48 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.531s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:48 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:20:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Deleted volume successfully. Apr 13 14:20:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ed79b6f-87a6-42f9-a87f-cbbac8735138 tempest-CinderUnicodeTest-2058840243 None] Lock "cinder-9eb13ddc-a4cc-4eb0-9e9f-4e0aa433f44a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fddbd5-74a8-40f8-b68a-1b00ca24decb]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:51 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:20:51 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:51 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a9af8-d3cc-4ef9-a742-1f45cf0ee98c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:51 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:20:51 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:51 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.7886f45c-5d6a-442a-9408-87ba12d961f94rc6tme1.img {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:51 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.7886f45c-5d6a-442a-9408-87ba12d961f94rc6tme1.img Apr 13 14:20:51 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:53 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.7886f45c-5d6a-442a-9408-87ba12d961f94rc6tme1.img" returned: 0 in 1.847s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c1f3ba-3b98-4da1-8b79-85932f64b4d8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:20:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:20:53 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:20:53 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:20:54 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 13 14:20:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.597s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:20:54 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.7886f45c-5d6a-442a-9408-87ba12d961f94rc6tme1.img {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:20:54 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Converted 1024.00 MB image at 553.81 MB/s Apr 13 14:20:54 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] 7886f45c-5d6a-442a-9408-87ba12d961f9 was raw, no need to convert to raw {{(pid=82621) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 13 14:21:01 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.023s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Uploaded volume to glance image-id: 7886f45c-5d6a-442a-9408-87ba12d961f9. {{(pid=82621) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 14:21:04 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-773e11a0-bf3c-4600-8d22-2ed9fe82b47f tempest-VolumesActionsTest-342559379 None] Copy volume to image completed successfully. Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=30,cinder:UPDATE=24,cinder:INSERT=11,cinder:DELETE=2 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41507df-2f5b-460a-ad31-b01a1f21708a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:04 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:21:04 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:05 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:05 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0cb133-903b-40d4-956a-0957fa9e2af3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:05 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:21:05 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:05 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:05 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img Apr 13 14:21:05 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:07 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img" returned: 0 in 1.832s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db0f64-0ec0-45ff-936c-4e078c2dbac8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:07 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:21:07 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:08 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.611s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:21:08 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Converted 1024.00 MB image at 558.54 MB/s Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] 4baa2311-737c-40f7-8081-5763b0888958 was raw, converting to qcow2 {{(pid=82621) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8842ab-ce3d-4b54-84b3-6b0bc545d41e]: (4, 'raw') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:08 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img Apr 13 14:21:08 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:08 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:08 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img Apr 13 14:21:08 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:09 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img" returned: 1 in 0.479s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img' failed. Not Retrying. {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:09 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha Apr 13 14:21:09 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:09 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha" returned: 0 in 0.420s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Image conversion details: src /opt/stack/data/cinder/conversion/4f75bf5f-22c5-4909-b59d-3d8e68bb7511.temp_image.4baa2311-737c-40f7-8081-5763b0888958a4ru4v4t.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:21:09 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4961ba-25d2-40c0-a46b-305d775567dd]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:09 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha Apr 13 14:21:09 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:10 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z0ksx0ha" returned: 0 in 0.481s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.101s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Uploaded volume to glance image-id: 4baa2311-737c-40f7-8081-5763b0888958. {{(pid=82621) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 14:21:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-853029d7-0b68-48b1-b782-6728afc61ede tempest-VolumesActionsTest-342559379 None] Copy volume to image completed successfully. Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Acquiring lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Acquiring lock "cinder-quobyte-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Lock "cinder-quobyte-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b033a2b-e043-46bd-b4e1-9e4845f738e1]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:11 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:21:11 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:11 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.477s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:12 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511 Apr 13 14:21:12 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:12 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" returned: 0 in 0.417s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Lock "cinder-quobyte-4f75bf5f-22c5-4909-b59d-3d8e68bb7511" released by "delete_volume" :: held 0.915s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Created reservations ['7018debc-572c-416f-bc2f-65a855661603', 'bc1ac65c-d9d6-4051-93fd-258f77b6d9a2', 'ec8b8159-2bd5-41a5-8483-a96424447159', '4980fe20-b4b0-440f-a9c9-9450f0d902a6'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:12 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:21:12 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:12 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.446s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:21:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Deleted volume successfully. Apr 13 14:21:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ecbdabd7-1024-4043-9dc2-479a97ad8de2 tempest-VolumesActionsTest-342559379 None] Lock "cinder-4f75bf5f-22c5-4909-b59d-3d8e68bb7511-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Flow 'volume_create_manager' (e396e32c-8d92-436f-ab8f-00af9af7e9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eabf505-6f53-408c-b864-5d5d58e41684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eabf505-6f53-408c-b864-5d5d58e41684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-478379987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf45a530-d9f9-4d1f-a12c-471de5e42776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082bb8fc0bf54fb08eb243dbcc8f9cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:21:17Z,use_quota=True,user_id='865c2d2c1d8542d5be3228467d5915cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c9deee-1fd2-42f5-abd8-2392ef071bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c9deee-1fd2-42f5-abd8-2392ef071bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db19c09f-320d-4a33-813d-47c845b31711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db19c09f-320d-4a33-813d-47c845b31711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf45a530-d9f9-4d1f-a12c-471de5e42776', 'volume_name': 'volume-bf45a530-d9f9-4d1f-a12c-471de5e42776', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3107be-b835-4545-b096-ab0134df0f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3107be-b835-4545-b096-ab0134df0f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222ddd5d-81ae-4659-93a4-d296eb17fa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:16 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Volume bf45a530-d9f9-4d1f-a12c-471de5e42776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf45a530-d9f9-4d1f-a12c-471de5e42776', 'volume_size': 1} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-478379987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf45a530-d9f9-4d1f-a12c-471de5e42776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='082bb8fc0bf54fb08eb243dbcc8f9cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:21:17Z,use_quota=True,user_id='865c2d2c1d8542d5be3228467d5915cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Creating volume bf45a530-d9f9-4d1f-a12c-471de5e42776 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:21:16 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:21:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:16 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 1073741824 Apr 13 14:21:16 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:17 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 1073741824" returned: 0 in 0.494s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:17 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 Apr 13 14:21:17 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:17 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776" returned: 0 in 0.409s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222ddd5d-81ae-4659-93a4-d296eb17fa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf45a530-d9f9-4d1f-a12c-471de5e42776', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6907de4b-b47a-4586-a881-fc4d9ff6a1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Volume volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 (bf45a530-d9f9-4d1f-a12c-471de5e42776): created successfully Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6907de4b-b47a-4586-a881-fc4d9ff6a1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Flow 'volume_create_manager' (e396e32c-8d92-436f-ab8f-00af9af7e9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:21:17 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7f58e6ff-1e17-4088-a5b0-eca887c77a83 tempest-VolumesNegativeTest-331168995 None] Created volume successfully. Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:19 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:21:19 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:19 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:21:27 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:21:27 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:21:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Acquiring lock "cinder-bf45a530-d9f9-4d1f-a12c-471de5e42776-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Lock "cinder-bf45a530-d9f9-4d1f-a12c-471de5e42776-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Acquiring lock "cinder-quobyte-bf45a530-d9f9-4d1f-a12c-471de5e42776" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:41 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Lock "cinder-quobyte-bf45a530-d9f9-4d1f-a12c-471de5e42776" acquired by "delete_volume" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:41 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d80dd8-4ef9-48a9-869f-2688e02a91b6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:41 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 Apr 13 14:21:41 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:42 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776" returned: 0 in 0.459s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:42 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776 Apr 13 14:21:42 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:42 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-bf45a530-d9f9-4d1f-a12c-471de5e42776" returned: 0 in 0.412s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Lock "cinder-quobyte-bf45a530-d9f9-4d1f-a12c-471de5e42776" released by "delete_volume" :: held 0.898s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Created reservations ['68714677-5650-436d-875c-04c93bbfa2b4', '234d731a-5549-439f-a3d4-d6d6d86be9cc', '4233220b-d57f-428e-b3d3-61bed120ee95', '49b65e72-5421-4ffe-9ae8-773d7104de08'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:42 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:21:42 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:43 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:43 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:21:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Deleted volume successfully. Apr 13 14:21:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f060a866-4406-4d70-a186-45cd1ac53294 tempest-VolumesNegativeTest-331168995 None] Lock "cinder-bf45a530-d9f9-4d1f-a12c-471de5e42776-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Flow 'volume_create_manager' (015fd49c-3474-45f6-a74a-1346000c4152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a7a1ae-a70d-4def-b77b-8717a6f223a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a7a1ae-a70d-4def-b77b-8717a6f223a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-274731139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b31e92d-4652-4b92-9273-3e6601010801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6fec28c4f04da2a0d06dbce4435d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:21:44Z,use_quota=True,user_id='e916d4bcbc4f4bcfbe1818af973335d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef914cfc-6eab-4416-b041-05eef6cdfebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef914cfc-6eab-4416-b041-05eef6cdfebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2ea8da-c68c-4b9a-800d-b38965378d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2ea8da-c68c-4b9a-800d-b38965378d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b31e92d-4652-4b92-9273-3e6601010801', 'volume_name': 'volume-8b31e92d-4652-4b92-9273-3e6601010801', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4bd01b-0841-4143-8d02-288b28855c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4bd01b-0841-4143-8d02-288b28855c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf97fea-3402-4f38-929b-78308983d757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Volume 8b31e92d-4652-4b92-9273-3e6601010801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b31e92d-4652-4b92-9273-3e6601010801', 'volume_size': 1} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-274731139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b31e92d-4652-4b92-9273-3e6601010801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6fec28c4f04da2a0d06dbce4435d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:21:44Z,use_quota=True,user_id='e916d4bcbc4f4bcfbe1818af973335d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Creating volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:21:44 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:44 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 1073741824 Apr 13 14:21:44 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:44 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 1073741824" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:44 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 Apr 13 14:21:44 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:45 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801" returned: 0 in 0.397s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf97fea-3402-4f38-929b-78308983d757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b31e92d-4652-4b92-9273-3e6601010801', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ea0bbb-969d-41dc-a696-323892620bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:21:45 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Volume volume-8b31e92d-4652-4b92-9273-3e6601010801 (8b31e92d-4652-4b92-9273-3e6601010801): created successfully Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ea0bbb-969d-41dc-a696-323892620bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Flow 'volume_create_manager' (015fd49c-3474-45f6-a74a-1346000c4152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:21:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-08ff9bf7-2fe9-4526-bc8e-46281ad96d7a tempest-VolumesSnapshotListTestJSON-1670850498 None] Created volume successfully. Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Creating offline snapshot b059eb18-2dac-4d58-b858-dc50f7f09418 of volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e23b9-369c-4fb9-a0f2-ed03a3601833]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:45 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 Apr 13 14:21:45 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:45 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801" returned: 0 in 0.453s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:45 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 1G Apr 13 14:21:45 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:46 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 1G" returned: 0 in 0.458s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:46 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:46 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:46 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.404s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:46 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 is being set with open permissions: ugo+rw Apr 13 14:21:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:46 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:46 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:47 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.406s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:47 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info Apr 13 14:21:47 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:47 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info" returned: 0 in 0.404s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:47 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info is being set with open permissions: ugo+rw Apr 13 14:21:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:47 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info Apr 13 14:21:47 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:47 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.info" returned: 0 in 0.386s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-e36509c1-3d84-4e49-9e46-2174e489ac31 tempest-VolumesSnapshotListTestJSON-1670850498 None] Create snapshot completed successfully Apr 13 14:21:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Creating offline snapshot 18c9df42-73a4-43d7-8883-d780a902ffb5 of volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:21:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d5c6ed-17f4-49af-9afb-321df5a6a4d8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:48 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:48 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:49 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.452s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:49 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 1G Apr 13 14:21:49 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:49 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 1G" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:49 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:49 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:49 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.411s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:49 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 is being set with open permissions: ugo+rw Apr 13 14:21:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:49 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:49 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:50 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2cbaedfd-c78c-4fb4-84dc-e19f3a534053 tempest-VolumesSnapshotListTestJSON-1670850498 None] Create snapshot completed successfully Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Creating offline snapshot 7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 of volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac7e0a-6deb-4143-b0af-e4549212b412]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:50 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:50 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:51 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:51 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 1G Apr 13 14:21:51 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:51 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 1G" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:51 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 Apr 13 14:21:51 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:52 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" returned: 0 in 0.446s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:52 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 is being set with open permissions: ugo+rw Apr 13 14:21:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:52 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 Apr 13 14:21:52 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:52 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" returned: 0 in 0.384s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:21:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ab4c4d37-85d6-4770-a19e-1514f8c484b3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Create snapshot completed successfully Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-7a655fcf-bc82-45fa-884b-1f3e0e2aaa21-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-7a655fcf-bc82-45fa-884b-1f3e0e2aaa21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Deleting offline snapshot 7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 of volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] snapshot_file for this snap is: volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e09da2-a457-4059-b199-c99c23ff7b55]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:53 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 Apr 13 14:21:53 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:53 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c141428b-aaad-42c7-abd1-574ff881d525]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:53 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:53 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:54 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.454s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:54 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 Apr 13 14:21:54 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:54 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" returned: 0 in 0.459s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:54 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21 Apr 13 14:21:54 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:55 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-7a655fcf-bc82-45fa-884b-1f3e0e2aaa21" released by "_delete_snapshot" :: held 1.823s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" released by "delete_snapshot" :: held 1.835s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Created reservations ['8047dd4c-cc38-4444-ada9-bd979c03f877', 'ba52e944-791a-4e38-adb7-9975b7ba1376', '01a8481f-2bc2-40f7-a75f-94decbfb6c6f', '7b6b5114-d4a8-488d-90f2-691277e637e8'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:21:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Delete snapshot completed successfully. Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6ff060c9-70ec-4936-bc72-6990cfa6863e tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-7a655fcf-bc82-45fa-884b-1f3e0e2aaa21-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-18c9df42-73a4-43d7-8883-d780a902ffb5-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-18c9df42-73a4-43d7-8883-d780a902ffb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-18c9df42-73a4-43d7-8883-d780a902ffb5" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-18c9df42-73a4-43d7-8883-d780a902ffb5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Deleting offline snapshot 18c9df42-73a4-43d7-8883-d780a902ffb5 of volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] snapshot_file for this snap is: volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df61934e-8916-4eb5-be04-f4a2c58e307a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:55 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:55 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:56 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ebc5ff-7e56-4890-9ca6-c730fc9f28b8]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:56 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:56 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:56 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.510s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:56 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:56 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:56 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.453s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:57 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5 Apr 13 14:21:57 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:57 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.18c9df42-73a4-43d7-8883-d780a902ffb5" returned: 0 in 0.407s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-18c9df42-73a4-43d7-8883-d780a902ffb5" released by "_delete_snapshot" :: held 1.889s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" released by "delete_snapshot" :: held 1.900s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Created reservations ['3ec2f3e5-f6c5-4044-ab25-34f6411b3fd0', 'c82d60e7-f622-4244-ab7f-748a7bee97f3', '0ada02a0-0aa3-4cbf-ae6e-28f38bcaaff8', '84a46ce8-2d5b-4223-9d0a-55a54f69dc49'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:21:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Delete snapshot completed successfully. Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-584862bd-df25-437b-b66a-dd9dbbb439c3 tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-18c9df42-73a4-43d7-8883-d780a902ffb5-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-b059eb18-2dac-4d58-b858-dc50f7f09418-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-b059eb18-2dac-4d58-b858-dc50f7f09418-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-b059eb18-2dac-4d58-b858-dc50f7f09418" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-b059eb18-2dac-4d58-b858-dc50f7f09418" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Deleting offline snapshot b059eb18-2dac-4d58-b858-dc50f7f09418 of volume 8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] snapshot_file for this snap is: volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb60f05-334a-424f-ad9f-d261a5e4343e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:57 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:57 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:58 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.458s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b31e92d-4652-4b92-9273-3e6601010801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:21:58 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee66c3-57c3-4a4f-b9e7-8d7122afc154]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:58 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 Apr 13 14:21:58 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:58 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801" returned: 0 in 0.476s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:58 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:58 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:59 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:59 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418 Apr 13 14:21:59 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:21:59 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801.b059eb18-2dac-4d58-b858-dc50f7f09418" returned: 0 in 0.395s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-b059eb18-2dac-4d58-b858-dc50f7f09418" released by "_delete_snapshot" :: held 1.832s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" released by "delete_snapshot" :: held 1.843s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Created reservations ['046457a7-0b56-41d9-9d6d-d7288a2e68b4', '7823a488-5ebf-4853-a0d1-42ffa5e145d4', 'e52ca017-c2bc-4bbc-b8d6-40d58cdfdba9', '263dc0fe-64d2-44ba-97b3-55e347778d49'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:21:59 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Delete snapshot completed successfully. Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0777c547-2a9a-4fed-9a7e-104deac5c8aa tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-b059eb18-2dac-4d58-b858-dc50f7f09418-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-8b31e92d-4652-4b92-9273-3e6601010801-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-8b31e92d-4652-4b92-9273-3e6601010801-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44e7373-b6e6-4aaa-a661-968eae5ce7f0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:21:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:21:59 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 Apr 13 14:21:59 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:00 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801" returned: 0 in 0.449s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:00 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801 Apr 13 14:22:00 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:00 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8b31e92d-4652-4b92-9273-3e6601010801" returned: 0 in 0.408s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-quobyte-8b31e92d-4652-4b92-9273-3e6601010801" released by "delete_volume" :: held 0.893s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Created reservations ['0c49b458-7a88-4852-8417-c9de1dc25739', 'ec82a9be-72a9-4653-8556-dc0a875dc1af', '92930b80-2066-4031-b5f9-2f7c7a9c29e5', 'c65d5a28-1006-44a0-93bb-77b12475a6ca'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:00 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:00 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:01 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.456s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:01 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:01 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Deleted volume successfully. Apr 13 14:22:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6cef1f66-0c03-4757-95c2-8a440dc4898f tempest-VolumesSnapshotListTestJSON-1670850498 None] Lock "cinder-8b31e92d-4652-4b92-9273-3e6601010801-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (baf575e5-480c-4812-bcd0-fce438651ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419a59e2-524e-4f2f-9f83-858cd3220c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419a59e2-524e-4f2f-9f83-858cd3220c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795436037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db567d2b-1374-420e-9abc-bf5b746221b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:02Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c49fc5-89a2-4a09-b43c-e9c76b9963a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c49fc5-89a2-4a09-b43c-e9c76b9963a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fec107d-5581-43ef-b92c-4c1d58093137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fec107d-5581-43ef-b92c-4c1d58093137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db567d2b-1374-420e-9abc-bf5b746221b9', 'volume_name': 'volume-db567d2b-1374-420e-9abc-bf5b746221b9', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86be4768-2b01-4275-9e4c-b80fdd7f8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86be4768-2b01-4275-9e4c-b80fdd7f8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b15075-93d4-4670-b945-ad6dc279e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Volume db567d2b-1374-420e-9abc-bf5b746221b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db567d2b-1374-420e-9abc-bf5b746221b9', 'volume_size': 1} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795436037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db567d2b-1374-420e-9abc-bf5b746221b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:02Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Creating volume db567d2b-1374-420e-9abc-bf5b746221b9 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:02 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:02 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 1073741824 Apr 13 14:22:02 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (cd37f8e9-481a-4e2b-a675-58659081eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9d515f-1e99-48ed-9e37-ec1b1974c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9d515f-1e99-48ed-9e37-ec1b1974c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663021011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf12993-4526-4aae-92ce-9f13e35f61f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51eb0342-a990-4238-9cf0-045c6f778fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51eb0342-a990-4238-9cf0-045c6f778fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2e942d-320d-44ac-964a-7803d385178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2e942d-320d-44ac-964a-7803d385178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf12993-4526-4aae-92ce-9f13e35f61f5', 'volume_name': 'volume-daf12993-4526-4aae-92ce-9f13e35f61f5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73047d21-1786-488e-be72-909d9c53ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73047d21-1786-488e-be72-909d9c53ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b95398f-24cb-42f1-a75c-23e7cc62af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Volume daf12993-4526-4aae-92ce-9f13e35f61f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf12993-4526-4aae-92ce-9f13e35f61f5', 'volume_size': 1} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (264ec877-fd2b-44b3-baa1-807a4a432e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ba0739-5df6-4032-a5ba-e925125ef828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ba0739-5df6-4032-a5ba-e925125ef828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084037354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc40c0e4-b08e-4ffa-97cb-b068ed2f639e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9658ea-9bdb-482c-91ea-002a19560c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9658ea-9bdb-482c-91ea-002a19560c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618b4887-7316-4644-b2d8-c875629ae5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618b4887-7316-4644-b2d8-c875629ae5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc40c0e4-b08e-4ffa-97cb-b068ed2f639e', 'volume_name': 'volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d562da3-eab5-4d4a-bd69-7271c2117c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d562da3-eab5-4d4a-bd69-7271c2117c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f643093-c137-4786-bb2c-5a2b66eb4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:02 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Volume cc40c0e4-b08e-4ffa-97cb-b068ed2f639e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e', 'volume_size': 1} Apr 13 14:22:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (674b71da-0d83-4a84-ab54-401622bb8c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4c48ce-d076-44b5-b634-3d1b59dff1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4c48ce-d076-44b5-b634-3d1b59dff1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565235324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac44b631-5b9c-4147-b1e0-2f3bc37c9334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58637ae-33c2-4e82-95a7-f4b03ec0bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58637ae-33c2-4e82-95a7-f4b03ec0bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ed6cd2-e614-4912-92e3-7bd9c89fdd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ed6cd2-e614-4912-92e3-7bd9c89fdd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac44b631-5b9c-4147-b1e0-2f3bc37c9334', 'volume_name': 'volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2103f968-b715-47db-bc69-bf63daf4931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2103f968-b715-47db-bc69-bf63daf4931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7a02e4-3097-4b1c-ad8e-053dd9012376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Volume ac44b631-5b9c-4147-b1e0-2f3bc37c9334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334', 'volume_size': 1} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:03 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 1073741824" returned: 0 in 0.594s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:03 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 Apr 13 14:22:03 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (5601d15e-6a4f-4875-88a8-9bd7005629ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5527fbaa-3c98-4cc2-93cb-1fe776d6204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5527fbaa-3c98-4cc2-93cb-1fe776d6204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1455634349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb794e33-9ced-4fc7-9a50-e23155efee1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16950ea-ac79-4657-ae96-317bc4809dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16950ea-ac79-4657-ae96-317bc4809dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fc7694-78ba-4321-b501-382c988a670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fc7694-78ba-4321-b501-382c988a670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb794e33-9ced-4fc7-9a50-e23155efee1e', 'volume_name': 'volume-eb794e33-9ced-4fc7-9a50-e23155efee1e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd434b4-df74-47d3-8828-7427141afcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd434b4-df74-47d3-8828-7427141afcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d2edce-2d9d-4597-8a2b-ea39d625db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Volume eb794e33-9ced-4fc7-9a50-e23155efee1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb794e33-9ced-4fc7-9a50-e23155efee1e', 'volume_size': 1} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:03 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663021011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf12993-4526-4aae-92ce-9f13e35f61f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Creating volume daf12993-4526-4aae-92ce-9f13e35f61f5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:03 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b15075-93d4-4670-b945-ad6dc279e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db567d2b-1374-420e-9abc-bf5b746221b9', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca10a558-a6d6-42ff-8065-e0abc2230e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:03 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 1073741824 Apr 13 14:22:03 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:03 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Volume volume-db567d2b-1374-420e-9abc-bf5b746221b9 (db567d2b-1374-420e-9abc-bf5b746221b9): created successfully Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca10a558-a6d6-42ff-8065-e0abc2230e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:03 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (baf575e5-480c-4812-bcd0-fce438651ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:03 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b73d5b42-b982-4b73-bcd7-feea44225d30 tempest-CreateVolumesFromImageTest-989563088 None] Created volume successfully. Apr 13 14:22:04 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 1073741824" returned: 0 in 0.470s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:04 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 Apr 13 14:22:04 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:04 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084037354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc40c0e4-b08e-4ffa-97cb-b068ed2f639e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Creating volume cc40c0e4-b08e-4ffa-97cb-b068ed2f639e {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:04 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b95398f-24cb-42f1-a75c-23e7cc62af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf12993-4526-4aae-92ce-9f13e35f61f5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1e9e6c-d319-47be-9775-2a10363d5fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:04 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e 1073741824 Apr 13 14:22:04 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:04 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Volume volume-daf12993-4526-4aae-92ce-9f13e35f61f5 (daf12993-4526-4aae-92ce-9f13e35f61f5): created successfully Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1e9e6c-d319-47be-9775-2a10363d5fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (cd37f8e9-481a-4e2b-a675-58659081eb54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:04 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-20e84a30-856e-4d48-a165-b965dc52f672 tempest-CreateVolumesFromImageTest-989563088 None] Created volume successfully. Apr 13 14:22:04 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e 1073741824" returned: 0 in 0.469s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:05 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e Apr 13 14:22:05 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:05 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e" returned: 0 in 0.400s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565235324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac44b631-5b9c-4147-b1e0-2f3bc37c9334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Creating volume ac44b631-5b9c-4147-b1e0-2f3bc37c9334 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:05 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f643093-c137-4786-bb2c-5a2b66eb4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f8d23d-9af6-4f70-93a4-20320fe80021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:05 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 1073741824 Apr 13 14:22:05 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:05 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Volume volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e (cc40c0e4-b08e-4ffa-97cb-b068ed2f639e): created successfully Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f8d23d-9af6-4f70-93a4-20320fe80021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (264ec877-fd2b-44b3-baa1-807a4a432e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:05 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bb6bd277-d628-453e-b113-5e9a145b1c57 tempest-CreateVolumesFromImageTest-989563088 None] Created volume successfully. Apr 13 14:22:05 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 1073741824" returned: 0 in 0.449s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:05 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 Apr 13 14:22:05 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:06 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334" returned: 0 in 0.382s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.808s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1455634349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb794e33-9ced-4fc7-9a50-e23155efee1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f52fb60507f46b586fc6f19da64ac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:03Z,use_quota=True,user_id='343f4f29b2184769b0f2a2501e475c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Creating volume eb794e33-9ced-4fc7-9a50-e23155efee1e {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:06 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7a02e4-3097-4b1c-ad8e-053dd9012376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192905c6-3e91-4a9e-b64a-77731072bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:06 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e 1073741824 Apr 13 14:22:06 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:06 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Volume volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 (ac44b631-5b9c-4147-b1e0-2f3bc37c9334): created successfully Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192905c6-3e91-4a9e-b64a-77731072bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (674b71da-0d83-4a84-ab54-401622bb8c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-249fa12e-da62-49b6-95d7-e0fdcb72c167 tempest-CreateVolumesFromImageTest-989563088 None] Created volume successfully. Apr 13 14:22:06 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e 1073741824" returned: 0 in 0.470s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:06 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e Apr 13 14:22:06 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:07 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e" returned: 0 in 0.388s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d2edce-2d9d-4597-8a2b-ea39d625db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb794e33-9ced-4fc7-9a50-e23155efee1e', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed07a9cc-fc0f-425d-84ad-8394c3648668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:07 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Volume volume-eb794e33-9ced-4fc7-9a50-e23155efee1e (eb794e33-9ced-4fc7-9a50-e23155efee1e): created successfully Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed07a9cc-fc0f-425d-84ad-8394c3648668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Flow 'volume_create_manager' (5601d15e-6a4f-4875-88a8-9bd7005629ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:07 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-849aebd4-1795-4be3-af5d-74cd8bfeaf77 tempest-CreateVolumesFromImageTest-989563088 None] Created volume successfully. Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-eb794e33-9ced-4fc7-9a50-e23155efee1e-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-eb794e33-9ced-4fc7-9a50-e23155efee1e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-quobyte-eb794e33-9ced-4fc7-9a50-e23155efee1e" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-eb794e33-9ced-4fc7-9a50-e23155efee1e" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4770bc8-1028-408d-831d-7c12c922f4a9]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:07 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e Apr 13 14:22:07 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:08 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:08 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e Apr 13 14:22:08 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:08 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-eb794e33-9ced-4fc7-9a50-e23155efee1e" returned: 0 in 0.410s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-eb794e33-9ced-4fc7-9a50-e23155efee1e" released by "delete_volume" :: held 0.897s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Created reservations ['ccd159b9-b230-4c27-a6a0-eeae6fef3f21', '65e41777-f0ae-4e86-b622-2354dd071c07', '717d0179-61ee-4324-aaba-8295487f5055', '2b562277-9ad5-440c-b252-e6a51dd58560'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:08 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:08 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-ac44b631-5b9c-4147-b1e0-2f3bc37c9334-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-ac44b631-5b9c-4147-b1e0-2f3bc37c9334-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-quobyte-ac44b631-5b9c-4147-b1e0-2f3bc37c9334" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-ac44b631-5b9c-4147-b1e0-2f3bc37c9334" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2973ff80-a80e-4105-b48d-43944f0929bf]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:08 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 Apr 13 14:22:08 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:09 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.445s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:09 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Deleted volume successfully. Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f65fa27f-92cd-40f4-bec7-888bf60d24ce tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-eb794e33-9ced-4fc7-9a50-e23155efee1e-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:09 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:09 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334 Apr 13 14:22:09 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:09 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ac44b631-5b9c-4147-b1e0-2f3bc37c9334" returned: 0 in 0.383s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-ac44b631-5b9c-4147-b1e0-2f3bc37c9334" released by "delete_volume" :: held 0.888s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Created reservations ['d161a886-21bb-4fc1-a894-09081efb4cba', '79781bed-fb85-4695-b08c-a6ed0c16b421', '710df70a-c750-422c-8a70-f443eb75c5bc', 'a7ca5c31-fd35-42f2-a80d-eb10429994ff'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:09 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:09 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-quobyte-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c8639b-0d67-444d-8ab6-e9c67de6d289]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:10 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e Apr 13 14:22:10 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:10 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.427s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:10 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Deleted volume successfully. Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5d1232ea-8892-4b67-94a9-3bffd1f242a4 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-ac44b631-5b9c-4147-b1e0-2f3bc37c9334-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:10 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:10 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e Apr 13 14:22:10 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:10 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e" returned: 0 in 0.388s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e" released by "delete_volume" :: held 0.877s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:10 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Created reservations ['282c8baf-19fd-4e48-9576-7e5d3833f983', 'aa5e362f-69bd-4951-bd08-1d6cbce965da', 'a83689d9-959d-45c3-982a-b35fe485672b', 'c79f48bd-88fd-4a52-a024-f72fec013302'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:11 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:11 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-daf12993-4526-4aae-92ce-9f13e35f61f5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-daf12993-4526-4aae-92ce-9f13e35f61f5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-quobyte-daf12993-4526-4aae-92ce-9f13e35f61f5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-daf12993-4526-4aae-92ce-9f13e35f61f5" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3690df17-4e52-4c05-80a3-3ab2a12c5214]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:11 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 Apr 13 14:22:11 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:11 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.434s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Deleted volume successfully. Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-79124c03-5abc-4001-949e-3c9216aeb307 tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-cc40c0e4-b08e-4ffa-97cb-b068ed2f639e-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:11 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:11 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5 Apr 13 14:22:11 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:11 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-daf12993-4526-4aae-92ce-9f13e35f61f5" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-daf12993-4526-4aae-92ce-9f13e35f61f5" released by "delete_volume" :: held 0.896s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Created reservations ['2f59dc92-d8d2-4af4-84f4-f54853c667c7', '3628007d-1858-4562-8b2b-336a3e28cae1', 'e832ece3-ffb9-4727-a955-4556acd35a3c', 'bc506685-08dd-499e-ab9e-77062bce9b39'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:12 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:12 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-db567d2b-1374-420e-9abc-bf5b746221b9-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-db567d2b-1374-420e-9abc-bf5b746221b9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "cinder-quobyte-db567d2b-1374-420e-9abc-bf5b746221b9" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-db567d2b-1374-420e-9abc-bf5b746221b9" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f1e504-d797-43a9-854e-ac56c018ecbc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:12 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 Apr 13 14:22:12 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:12 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Deleted volume successfully. Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-52046800-b062-49f8-86ce-43b94946413d tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-daf12993-4526-4aae-92ce-9f13e35f61f5-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:12 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:12 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9 Apr 13 14:22:12 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:13 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-db567d2b-1374-420e-9abc-bf5b746221b9" returned: 0 in 0.400s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-quobyte-db567d2b-1374-420e-9abc-bf5b746221b9" released by "delete_volume" :: held 0.879s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Created reservations ['d194d75c-9403-4a98-bf7d-dd43c1194474', '7c7feae4-aa6e-4113-8e6f-af373d2e560f', '364f2c80-3c93-4115-947c-797dfaf9cfb0', '562c563e-2cf4-417f-93a1-7732f32138db'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:13 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:13 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:13 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.465s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Deleted volume successfully. Apr 13 14:22:13 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fc16d9dc-78bc-4547-b2ea-7fb6eb0763dc tempest-CreateVolumesFromImageTest-989563088 None] Lock "cinder-db567d2b-1374-420e-9abc-bf5b746221b9-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (ab949f32-4f8f-4fc9-80b5-8c2017f1d5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8c64b4-4ab9-4b3d-a5ec-d87fb9091bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8c64b4-4ab9-4b3d-a5ec-d87fb9091bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348460753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622a14d3-4878-4670-ab26-5eac762d980b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:15Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdadbf3d-3058-4206-ae7d-0ee43ff29638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdadbf3d-3058-4206-ae7d-0ee43ff29638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df556a2d-9bca-4ef6-a878-9619bfaecac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df556a2d-9bca-4ef6-a878-9619bfaecac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622a14d3-4878-4670-ab26-5eac762d980b', 'volume_name': 'volume-622a14d3-4878-4670-ab26-5eac762d980b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284aa708-8316-4b9e-b2e2-686e6067167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284aa708-8316-4b9e-b2e2-686e6067167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb5bded-e289-4922-9445-74e4b0b444b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:14 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume 622a14d3-4878-4670-ab26-5eac762d980b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622a14d3-4878-4670-ab26-5eac762d980b', 'volume_size': 1} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348460753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622a14d3-4878-4670-ab26-5eac762d980b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:15Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Creating volume 622a14d3-4878-4670-ab26-5eac762d980b {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:15 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:15 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b 1073741824 Apr 13 14:22:15 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:15 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b 1073741824" returned: 0 in 0.452s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:15 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b Apr 13 14:22:15 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:15 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb5bded-e289-4922-9445-74e4b0b444b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622a14d3-4878-4670-ab26-5eac762d980b', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1fbd2a-35c0-4ab0-a1f1-bf42b4fc4243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:16 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume volume-622a14d3-4878-4670-ab26-5eac762d980b (622a14d3-4878-4670-ab26-5eac762d980b): created successfully Apr 13 14:22:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1fbd2a-35c0-4ab0-a1f1-bf42b4fc4243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:16 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (ab949f32-4f8f-4fc9-80b5-8c2017f1d5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:16 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-91d37151-74d1-43dd-a5af-39a199dc32e0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created volume successfully. Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (4e99622a-67b2-4366-8c24-3a643e922bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c22d663-f52e-4482-8cc8-29c42cb6579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c22d663-f52e-4482-8cc8-29c42cb6579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158552037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c58731-d708-4578-b0bf-2660b8eef60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:17Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5d5f22-80bc-4165-b399-4b12c3f581bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5d5f22-80bc-4165-b399-4b12c3f581bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb752c45-35e5-4e1a-aa5a-371b8865bcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb752c45-35e5-4e1a-aa5a-371b8865bcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c58731-d708-4578-b0bf-2660b8eef60a', 'volume_name': 'volume-b3c58731-d708-4578-b0bf-2660b8eef60a', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d051e1-ad27-4a4a-9a5c-ad229088238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d051e1-ad27-4a4a-9a5c-ad229088238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c1ff4c-b35f-4220-867b-626e098a5b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume b3c58731-d708-4578-b0bf-2660b8eef60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c58731-d708-4578-b0bf-2660b8eef60a', 'volume_size': 1} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158552037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c58731-d708-4578-b0bf-2660b8eef60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:17Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Creating volume b3c58731-d708-4578-b0bf-2660b8eef60a {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:17 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:17 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a 1073741824 Apr 13 14:22:17 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (3f816d5b-0add-4fc4-8479-1ba091e1f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d78e06-d363-441f-b998-9461ab3902e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d78e06-d363-441f-b998-9461ab3902e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205513989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0218bdba-3c28-4597-bf0e-a9cfabd4dd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:17Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9196be-3c93-48a4-9298-172216562d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9196be-3c93-48a4-9298-172216562d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4774fd-3396-4819-8c3e-a44575c925f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4774fd-3396-4819-8c3e-a44575c925f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0218bdba-3c28-4597-bf0e-a9cfabd4dd73', 'volume_name': 'volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbece37-713a-4a11-a5bf-7bc190000ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbece37-713a-4a11-a5bf-7bc190000ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dba3468-1afb-4717-8ead-f5e74ff6950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume 0218bdba-3c28-4597-bf0e-a9cfabd4dd73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73', 'volume_size': 1} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (9be342aa-0f52-4e29-b6d4-7f5b638f74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45435a92-3ed6-42fd-8428-cba3136e4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45435a92-3ed6-42fd-8428-cba3136e4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007819154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f39306-3093-4b82-8578-02d7b0b25ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:18Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9478c1aa-ea33-4fe7-acce-ae7377dd27a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9478c1aa-ea33-4fe7-acce-ae7377dd27a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a967c895-a5e9-4ce2-8323-558d6a8e0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a967c895-a5e9-4ce2-8323-558d6a8e0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f39306-3093-4b82-8578-02d7b0b25ed5', 'volume_name': 'volume-14f39306-3093-4b82-8578-02d7b0b25ed5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80566a0d-281d-4976-b44c-6ae5acb001b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80566a0d-281d-4976-b44c-6ae5acb001b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8745d20-c8c9-48d9-91c1-f7cc9718e2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume 14f39306-3093-4b82-8578-02d7b0b25ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f39306-3093-4b82-8578-02d7b0b25ed5', 'volume_size': 1} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (b01bffbd-5844-4050-8781-58034c3f9b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68472b8-03e7-47e8-98ed-71fdb2027e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a 1073741824" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68472b8-03e7-47e8-98ed-71fdb2027e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288846480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9afadb-aac9-4517-923c-5c1fb4ff292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:18Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6481eb2-fbdf-4abd-85aa-555e5fee4f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6481eb2-fbdf-4abd-85aa-555e5fee4f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2018eba-c116-427c-a022-162ac4a39c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2018eba-c116-427c-a022-162ac4a39c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9afadb-aac9-4517-923c-5c1fb4ff292a', 'volume_name': 'volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2a6ba7-d572-47f1-aae4-dc27f99b370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2a6ba7-d572-47f1-aae4-dc27f99b370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946b9393-5e21-4323-9bb0-91aee9e4e851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:17 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume 4e9afadb-aac9-4517-923c-5c1fb4ff292a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a', 'volume_size': 1} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:17 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a Apr 13 14:22:17 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (64de56e8-e871-4f36-a908-da80a2a127f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4eaf45-adfd-45a7-a178-7aaa34f6748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4eaf45-adfd-45a7-a178-7aaa34f6748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445411656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471320ca-bf00-49b5-8f63-e25d19fcbdd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:18Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a201b823-a5c0-49b3-9521-44aab3acf4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a201b823-a5c0-49b3-9521-44aab3acf4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337e17d9-134e-43bc-ae20-40c06af8b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337e17d9-134e-43bc-ae20-40c06af8b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471320ca-bf00-49b5-8f63-e25d19fcbdd7', 'volume_name': 'volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269bce2c-82a7-43f7-89aa-470499735770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269bce2c-82a7-43f7-89aa-470499735770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983a59c9-e48f-44d7-a850-2307ca1270f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:18 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume 471320ca-bf00-49b5-8f63-e25d19fcbdd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7', 'volume_size': 1} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:18 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a" returned: 0 in 0.418s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205513989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0218bdba-3c28-4597-bf0e-a9cfabd4dd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:17Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Creating volume 0218bdba-3c28-4597-bf0e-a9cfabd4dd73 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:18 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c1ff4c-b35f-4220-867b-626e098a5b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c58731-d708-4578-b0bf-2660b8eef60a', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:18 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 1073741824 Apr 13 14:22:18 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46badaf-6746-416c-8f1c-e591e10d9133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:18 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume volume-b3c58731-d708-4578-b0bf-2660b8eef60a (b3c58731-d708-4578-b0bf-2660b8eef60a): created successfully Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46badaf-6746-416c-8f1c-e591e10d9133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (4e99622a-67b2-4366-8c24-3a643e922bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:18 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b4d00a6e-853c-4fd9-ad25-e648af80273c tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created volume successfully. Apr 13 14:22:18 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 1073741824" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:18 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 Apr 13 14:22:18 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:19 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73" returned: 0 in 0.398s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007819154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f39306-3093-4b82-8578-02d7b0b25ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:18Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Creating volume 14f39306-3093-4b82-8578-02d7b0b25ed5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:19 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dba3468-1afb-4717-8ead-f5e74ff6950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e04b934-fa04-4b30-a32f-04599efc239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:19 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 1073741824 Apr 13 14:22:19 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:19 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 (0218bdba-3c28-4597-bf0e-a9cfabd4dd73): created successfully Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e04b934-fa04-4b30-a32f-04599efc239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (3f816d5b-0add-4fc4-8479-1ba091e1f744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-cee5b4c2-4617-4dad-92b8-2efcefceecca tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created volume successfully. Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:19 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:19 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:19 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 1073741824" returned: 0 in 0.494s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:19 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 Apr 13 14:22:19 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:19 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.409s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:20 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5" returned: 0 in 0.433s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288846480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9afadb-aac9-4517-923c-5c1fb4ff292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:18Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Creating volume 4e9afadb-aac9-4517-923c-5c1fb4ff292a {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:20 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8745d20-c8c9-48d9-91c1-f7cc9718e2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f39306-3093-4b82-8578-02d7b0b25ed5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:20 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a 1073741824 Apr 13 14:22:20 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ab747-b536-4fdf-bf0a-384b8869602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:20 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume volume-14f39306-3093-4b82-8578-02d7b0b25ed5 (14f39306-3093-4b82-8578-02d7b0b25ed5): created successfully Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ab747-b536-4fdf-bf0a-384b8869602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (9be342aa-0f52-4e29-b6d4-7f5b638f74e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:20 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-8d214c5f-3eeb-44f4-8156-12212958146d tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created volume successfully. Apr 13 14:22:20 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a 1073741824" returned: 0 in 0.448s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:20 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a Apr 13 14:22:20 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:21 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a" returned: 0 in 0.394s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.019s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445411656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471320ca-bf00-49b5-8f63-e25d19fcbdd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a140946db9fc41e7a87df6c8082586a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:18Z,use_quota=True,user_id='4d440b84b2d94a89a0172cdd5c1eff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Creating volume 471320ca-bf00-49b5-8f63-e25d19fcbdd7 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:21 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946b9393-5e21-4323-9bb0-91aee9e4e851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:21 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 1073741824 Apr 13 14:22:21 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f5ca3-4374-425c-bf00-0cb68a669c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:21 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a (4e9afadb-aac9-4517-923c-5c1fb4ff292a): created successfully Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638f5ca3-4374-425c-bf00-0cb68a669c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (b01bffbd-5844-4050-8781-58034c3f9b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c5f9df71-f780-43cd-a537-d9e0de397a51 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created volume successfully. Apr 13 14:22:21 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 1073741824" returned: 0 in 0.496s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:21 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 Apr 13 14:22:21 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:22 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7" returned: 0 in 0.404s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983a59c9-e48f-44d7-a850-2307ca1270f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b51c13f-8391-4d56-a58e-f2373d7935e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:22 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Volume volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 (471320ca-bf00-49b5-8f63-e25d19fcbdd7): created successfully Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b51c13f-8391-4d56-a58e-f2373d7935e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Flow 'volume_create_manager' (64de56e8-e871-4f36-a908-da80a2a127f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-69ddcd98-5407-4a25-82c3-0916aceef0f0 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created volume successfully. Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-471320ca-bf00-49b5-8f63-e25d19fcbdd7-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-471320ca-bf00-49b5-8f63-e25d19fcbdd7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-quobyte-471320ca-bf00-49b5-8f63-e25d19fcbdd7" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-471320ca-bf00-49b5-8f63-e25d19fcbdd7" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a1bbf8-22b0-49b5-b024-4553171f826a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:22 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 Apr 13 14:22:22 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:22 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7" returned: 0 in 0.456s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:22 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7 Apr 13 14:22:22 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:23 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-471320ca-bf00-49b5-8f63-e25d19fcbdd7" returned: 0 in 0.402s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-471320ca-bf00-49b5-8f63-e25d19fcbdd7" released by "delete_volume" :: held 0.882s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created reservations ['1f0375d3-5e6d-4c71-9115-6f8057df3bd5', '9af11f9d-2b10-414e-b111-24db8cc98ca3', '27933729-2dea-48ef-b691-bcf9683a9130', '4fc7e109-d26e-4136-a55c-9fc998e8c865'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:23 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:23 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-4e9afadb-aac9-4517-923c-5c1fb4ff292a-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-4e9afadb-aac9-4517-923c-5c1fb4ff292a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-quobyte-4e9afadb-aac9-4517-923c-5c1fb4ff292a" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-4e9afadb-aac9-4517-923c-5c1fb4ff292a" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b73017-f930-43af-a428-9f06d906eb6a]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:23 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a Apr 13 14:22:23 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:23 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Deleted volume successfully. Apr 13 14:22:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0b0ee7fb-269b-4ca5-ac83-4dd3ae1d54fb tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-471320ca-bf00-49b5-8f63-e25d19fcbdd7-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:24 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a" returned: 0 in 0.480s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:24 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a Apr 13 14:22:24 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:24 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4e9afadb-aac9-4517-923c-5c1fb4ff292a" returned: 0 in 0.399s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-4e9afadb-aac9-4517-923c-5c1fb4ff292a" released by "delete_volume" :: held 0.902s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created reservations ['416025fe-360d-4ac0-9e57-4236f9958a9a', 'f0ee660d-e0e7-4636-96be-4b505a5534cb', '5d6efab1-9798-4725-9f72-308618b70a67', '52385659-64fe-4788-b33d-abb8834cfc7b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:24 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:24 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-14f39306-3093-4b82-8578-02d7b0b25ed5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-14f39306-3093-4b82-8578-02d7b0b25ed5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-quobyte-14f39306-3093-4b82-8578-02d7b0b25ed5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-14f39306-3093-4b82-8578-02d7b0b25ed5" acquired by "delete_volume" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6362f221-1444-4e0b-bf8a-4c3542ea8d04]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:24 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 Apr 13 14:22:24 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:25 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.458s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Deleted volume successfully. Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6b010169-744a-46eb-b8d1-75ba49f632ba tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-4e9afadb-aac9-4517-923c-5c1fb4ff292a-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:25 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:25 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5 Apr 13 14:22:25 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:25 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-14f39306-3093-4b82-8578-02d7b0b25ed5" returned: 0 in 0.390s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-14f39306-3093-4b82-8578-02d7b0b25ed5" released by "delete_volume" :: held 0.860s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created reservations ['a8208ee0-d73c-4875-bcdb-78e94417517b', '6510cf56-7a05-42ca-b1b7-0dee0a62113a', 'e1787321-15f6-48c6-8d2f-c3ea97bb79a6', 'aaba9265-e828-4b9d-ac86-3ad05c9ae6ad'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:25 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:25 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-0218bdba-3c28-4597-bf0e-a9cfabd4dd73-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-0218bdba-3c28-4597-bf0e-a9cfabd4dd73-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-quobyte-0218bdba-3c28-4597-bf0e-a9cfabd4dd73" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-0218bdba-3c28-4597-bf0e-a9cfabd4dd73" acquired by "delete_volume" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2122756-0fa5-49aa-a69e-6dbf996dce9d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:25 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 Apr 13 14:22:25 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:26 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.449s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:26 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Deleted volume successfully. Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad1ac9d9-6e4d-422e-9d8e-2c12ddcae2e8 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-14f39306-3093-4b82-8578-02d7b0b25ed5-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:26 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73" returned: 0 in 0.463s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:26 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73 Apr 13 14:22:26 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:26 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0218bdba-3c28-4597-bf0e-a9cfabd4dd73" returned: 0 in 0.417s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-0218bdba-3c28-4597-bf0e-a9cfabd4dd73" released by "delete_volume" :: held 0.916s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created reservations ['eb9fd414-ee39-4636-9d75-b29987184f5b', '59a111ba-366c-4aaa-a9d6-46343b873823', 'ae39e0fa-b446-4649-a4cf-04081fcb70f3', '15d61cb6-792e-4b21-8048-b43c0908141e'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:26 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:26 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-b3c58731-d708-4578-b0bf-2660b8eef60a-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-b3c58731-d708-4578-b0bf-2660b8eef60a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-quobyte-b3c58731-d708-4578-b0bf-2660b8eef60a" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-b3c58731-d708-4578-b0bf-2660b8eef60a" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbd7a8-be95-44d3-94ae-87b6c3ce246b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:27 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a Apr 13 14:22:27 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:27 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.434s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:27 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Deleted volume successfully. Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0047df4c-b276-4cd8-ae6e-f10c557a537a tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-0218bdba-3c28-4597-bf0e-a9cfabd4dd73-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:27 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a" returned: 0 in 0.463s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:27 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a Apr 13 14:22:27 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:27 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-b3c58731-d708-4578-b0bf-2660b8eef60a" returned: 0 in 0.389s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-b3c58731-d708-4578-b0bf-2660b8eef60a" released by "delete_volume" :: held 0.875s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created reservations ['e45c4b9b-beea-4dfa-bfc0-77899e493170', 'c558faca-f8c8-4e3b-93a7-6753bc5c2d86', '8dd607ea-2e52-42e6-a7d2-34e8a0f6e4a0', '7c270251-145e-44a5-83e0-199e471dae98'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:27 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:27 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-622a14d3-4878-4670-ab26-5eac762d980b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-622a14d3-4878-4670-ab26-5eac762d980b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "cinder-quobyte-622a14d3-4878-4670-ab26-5eac762d980b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-622a14d3-4878-4670-ab26-5eac762d980b" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e8b142-d5f4-46ad-a98b-5899870208bc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:28 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b Apr 13 14:22:28 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:28 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.460s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Deleted volume successfully. Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-4af90f7a-7797-4d68-bf5d-cf786f6d7b1b tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-b3c58731-d708-4578-b0bf-2660b8eef60a-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:28 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b" returned: 0 in 0.467s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:28 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b Apr 13 14:22:28 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:28 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-622a14d3-4878-4670-ab26-5eac762d980b" returned: 0 in 0.390s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-quobyte-622a14d3-4878-4670-ab26-5eac762d980b" released by "delete_volume" :: held 0.879s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:28 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Created reservations ['b6c24d59-bcd8-4ba2-b3b4-65149c762d1b', 'aacf4191-9892-4766-aca8-682d4d19c4df', '53fa167a-3044-4b66-a253-a71890eae186', 'de1a439a-13fb-4d6f-a4fa-a3d34e26e0dc'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:29 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:29 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:29 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.432s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Deleted volume successfully. Apr 13 14:22:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-159bfb3f-6c03-4b75-b4bd-2bce960a9306 tempest-CreateVolumesFromSourceVolumeTest-1261297674 None] Lock "cinder-622a14d3-4878-4670-ab26-5eac762d980b-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=111,cinder:INSERT=34,cinder:UPDATE=175,cinder:DELETE=13 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:22:39 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=145,cinder:SELECT=113,cinder:INSERT=43,cinder:DELETE=15 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Flow 'volume_create_manager' (e670d91c-4af0-40a3-9cbd-7c71749dafa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ff6e70-f038-4684-9120-7624813cc259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ff6e70-f038-4684-9120-7624813cc259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1032835130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3009e447-982d-477c-9e99-c54928307c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c5339fe69142d9b9feb90da0a3545b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:41Z,use_quota=True,user_id='7ba3bcb3aae74051914f9dd4986bffd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e8903f-69a8-488c-a70f-5b9da02360c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e8903f-69a8-488c-a70f-5b9da02360c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cda8897-c333-42b0-b890-1ecd8842d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cda8897-c333-42b0-b890-1ecd8842d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3009e447-982d-477c-9e99-c54928307c5c', 'volume_name': 'volume-3009e447-982d-477c-9e99-c54928307c5c', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7f1540-e24a-4656-b453-fe15b4e7f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7f1540-e24a-4656-b453-fe15b4e7f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54080e7b-4be3-4479-994b-1dcd6b42d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:41 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Volume 3009e447-982d-477c-9e99-c54928307c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3009e447-982d-477c-9e99-c54928307c5c', 'volume_size': 1} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1032835130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3009e447-982d-477c-9e99-c54928307c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c5339fe69142d9b9feb90da0a3545b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:41Z,use_quota=True,user_id='7ba3bcb3aae74051914f9dd4986bffd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Creating volume 3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:41 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:41 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c 1073741824 Apr 13 14:22:41 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:41 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c 1073741824" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:41 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:41 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:42 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54080e7b-4be3-4479-994b-1dcd6b42d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3009e447-982d-477c-9e99-c54928307c5c', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9938e0-309c-4e76-8848-218a8b82befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Volume volume-3009e447-982d-477c-9e99-c54928307c5c (3009e447-982d-477c-9e99-c54928307c5c): created successfully Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9938e0-309c-4e76-8848-218a8b82befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Flow 'volume_create_manager' (e670d91c-4af0-40a3-9cbd-7c71749dafa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2c8bf6d3-938b-4ffa-87f8-7ea6a428feb1 tempest-SnapshotDependencyTests-549496853 None] Created volume successfully. Apr 13 14:22:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Creating offline snapshot 45bbf134-286d-4c38-8ca9-d9d35248346c of volume 3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:22:43 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccec616-d034-40a4-89b0-50096bb81320]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:43 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:43 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:44 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:44 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c 1G Apr 13 14:22:44 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:44 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c 1G" returned: 0 in 0.453s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3009e447-982d-477c-9e99-c54928307c5c -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:44 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3009e447-982d-477c-9e99-c54928307c5c -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c Apr 13 14:22:44 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:45 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3009e447-982d-477c-9e99-c54928307c5c -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c" returned: 0 in 0.425s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:45 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c is being set with open permissions: ugo+rw Apr 13 14:22:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:45 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c Apr 13 14:22:45 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:45 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c" returned: 0 in 0.418s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:45 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info Apr 13 14:22:45 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:45 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info" returned: 0 in 0.407s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:45 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info is being set with open permissions: ugo+rw Apr 13 14:22:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:45 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info Apr 13 14:22:45 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:46 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.info" returned: 0 in 0.437s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-99f71722-bb78-4aed-b5d9-af7c50eda44d tempest-SnapshotDependencyTests-549496853 None] Create snapshot completed successfully Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Flow 'volume_create_manager' (b529d863-bbbc-4e76-a037-58f14f879104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2608eb-148c-412a-8f98-cfeed4a5dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2608eb-148c-412a-8f98-cfeed4a5dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb5f34c-831e-4e80-a13c-2161cc9c137b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c5339fe69142d9b9feb90da0a3545b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45bbf134-286d-4c38-8ca9-d9d35248346c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:22:47Z,use_quota=True,user_id='7ba3bcb3aae74051914f9dd4986bffd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb5bab9-4ec2-4f3f-9ccd-7dbbb64434ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb5bab9-4ec2-4f3f-9ccd-7dbbb64434ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580a0f88-8424-48d3-9c27-289f411688bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580a0f88-8424-48d3-9c27-289f411688bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3bb5f34c-831e-4e80-a13c-2161cc9c137b', 'volume_name': 'volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b', 'volume_size': 1, 'snapshot_id': '45bbf134-286d-4c38-8ca9-d9d35248346c'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefbafbe-5c21-4771-b2a6-b19094f9c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefbafbe-5c21-4771-b2a6-b19094f9c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eab9adb-db91-4cf6-b056-d4a56a1409b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:47 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Volume 3bb5f34c-831e-4e80-a13c-2161cc9c137b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b', 'volume_size': 1, 'snapshot_id': '45bbf134-286d-4c38-8ca9-d9d35248346c'} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-quobyte-45bbf134-286d-4c38-8ca9-d9d35248346c-3bb5f34c-831e-4e80-a13c-2161cc9c137b" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-45bbf134-286d-4c38-8ca9-d9d35248346c-3bb5f34c-831e-4e80-a13c-2161cc9c137b" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Creating volume 3bb5f34c-831e-4e80-a13c-2161cc9c137b from snapshot 45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-quobyte-3bb5f34c-831e-4e80-a13c-2161cc9c137b" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3bb5f34c-831e-4e80-a13c-2161cc9c137b" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] snapshot: 45bbf134-286d-4c38-8ca9-d9d35248346c, volume: 3bb5f34c-831e-4e80-a13c-2161cc9c137b, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f76787-3ee1-49a4-93d1-a0a6c026f26d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:47 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c Apr 13 14:22:47 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:47 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c" returned: 0 in 0.448s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3009e447-982d-477c-9e99-c54928307c5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d72d31-e7ce-4358-a20d-d0cad9fd00c6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:47 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:47 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:48 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.474s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:48 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:22:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:48 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b Apr 13 14:22:48 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:49 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b" returned: 0 in 1.806s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38ce995-a3c5-44a9-8fb9-c880e042e1cd]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:50 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:50 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:50 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.570s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:22:50 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Converted 1024.00 MB image at 566.39 MB/s Apr 13 14:22:50 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b is being set with open permissions: ugo+rw Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:50 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b Apr 13 14:22:50 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:50 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b" returned: 0 in 0.390s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3bb5f34c-831e-4e80-a13c-2161cc9c137b" released by "_copy_volume_from_snapshot" :: held 3.741s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-45bbf134-286d-4c38-8ca9-d9d35248346c-3bb5f34c-831e-4e80-a13c-2161cc9c137b" released by "_create_volume_from_snapshot" :: held 3.755s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.762s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eab9adb-db91-4cf6-b056-d4a56a1409b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b', 'volume_size': 1, 'snapshot_id': '45bbf134-286d-4c38-8ca9-d9d35248346c'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b407cdb6-12b7-491c-ad3a-9e9ee4051090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:22:50 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Volume volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b (3bb5f34c-831e-4e80-a13c-2161cc9c137b): created successfully Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b407cdb6-12b7-491c-ad3a-9e9ee4051090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:22:50 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Flow 'volume_create_manager' (b529d863-bbbc-4e76-a037-58f14f879104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:22:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0e5e633b-bc15-42fd-92bd-0a961215f7b8 tempest-SnapshotDependencyTests-549496853 None] Created volume successfully. Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-45bbf134-286d-4c38-8ca9-d9d35248346c-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-45bbf134-286d-4c38-8ca9-d9d35248346c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-quobyte-3009e447-982d-477c-9e99-c54928307c5c" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3009e447-982d-477c-9e99-c54928307c5c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-quobyte-45bbf134-286d-4c38-8ca9-d9d35248346c" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-45bbf134-286d-4c38-8ca9-d9d35248346c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Deleting offline snapshot 45bbf134-286d-4c38-8ca9-d9d35248346c of volume 3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] snapshot_file for this snap is: volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a8184-097e-430a-94c2-0587c7707a0f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:51 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c Apr 13 14:22:51 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:51 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c" returned: 0 in 0.470s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3009e447-982d-477c-9e99-c54928307c5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb4181-2aef-430a-9459-f05d67a238cf]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:52 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:52 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:52 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:52 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c Apr 13 14:22:52 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:52 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c" returned: 0 in 0.433s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:52 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c Apr 13 14:22:52 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:53 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c.45bbf134-286d-4c38-8ca9-d9d35248346c" returned: 0 in 0.388s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-45bbf134-286d-4c38-8ca9-d9d35248346c" released by "_delete_snapshot" :: held 1.798s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3009e447-982d-477c-9e99-c54928307c5c" released by "delete_snapshot" :: held 1.811s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Created reservations ['0617b9e2-b08b-4721-beda-eaea46fcd724', 'cf6b341f-25a3-4303-be90-d08ffaf71200', '60ea4d41-bd3e-4834-b72d-6a0b4cc3b9d8', '9f785b65-98ed-4971-9a64-36e2a5b38ede'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:53 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Delete snapshot completed successfully. Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d00cd557-7ed8-48a8-88af-f7230497c2c3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-45bbf134-286d-4c38-8ca9-d9d35248346c-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-3009e447-982d-477c-9e99-c54928307c5c-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-3009e447-982d-477c-9e99-c54928307c5c-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-quobyte-3009e447-982d-477c-9e99-c54928307c5c" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3009e447-982d-477c-9e99-c54928307c5c" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf38b9-5fb8-4896-a3cd-2fa403365db6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:53 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:53 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:54 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.447s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:54 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c Apr 13 14:22:54 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:54 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3009e447-982d-477c-9e99-c54928307c5c" returned: 0 in 0.396s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3009e447-982d-477c-9e99-c54928307c5c" released by "delete_volume" :: held 0.877s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Created reservations ['d0e07013-6fa8-4cd6-8d3f-81c326286757', 'c1e2b0a4-a763-47c5-bc77-c1d65f34d37b', '9c376ee4-ba20-4169-94b9-d8fbced60d72', '4dba5ae5-f425-4213-add0-40b764209805'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:54 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:54 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-3bb5f34c-831e-4e80-a13c-2161cc9c137b-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-3bb5f34c-831e-4e80-a13c-2161cc9c137b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "cinder-quobyte-3bb5f34c-831e-4e80-a13c-2161cc9c137b" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3bb5f34c-831e-4e80-a13c-2161cc9c137b" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a86e1a-8eab-4bbd-a30c-51c6a1ea47ec]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:54 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b Apr 13 14:22:54 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:54 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:54 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Deleted volume successfully. Apr 13 14:22:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3ed3c13c-c150-4df4-9152-69e656423ca3 tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-3009e447-982d-477c-9e99-c54928307c5c-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:55 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b" returned: 0 in 0.461s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:55 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b Apr 13 14:22:55 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:55 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3bb5f34c-831e-4e80-a13c-2161cc9c137b" returned: 0 in 0.385s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-quobyte-3bb5f34c-831e-4e80-a13c-2161cc9c137b" released by "delete_volume" :: held 0.868s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Created reservations ['52f74594-40b4-42eb-9cc2-8734074e8024', '0c246dd0-a1a5-492f-8e8d-e57534d44f80', 'ec7b6aa0-300f-4847-9a5a-b6fb9e1a6c67', '7c52cf22-c870-482f-96b6-ed60639de2d5'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:22:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:22:55 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:22:55 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:22:56 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 13 14:22:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.422s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:22:56 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:22:56 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Deleted volume successfully. Apr 13 14:22:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-d9a783de-20ad-4391-832e-df57dc08540e tempest-SnapshotDependencyTests-549496853 None] Lock "cinder-3bb5f34c-831e-4e80-a13c-2161cc9c137b-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:05 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:23:06 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (fe7d4e32-eebb-4e9b-bef6-1a94ef8c7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeef0e91-0f6f-458f-b115-576a765e9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeef0e91-0f6f-458f-b115-576a765e9575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2108868707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6c7086-25f6-4aa8-9dd6-913469d84a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa180ad-82d6-440c-bed6-82b3b01efb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa180ad-82d6-440c-bed6-82b3b01efb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae431d1-3658-4573-9c11-1d76c9ff1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae431d1-3658-4573-9c11-1d76c9ff1eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6c7086-25f6-4aa8-9dd6-913469d84a87', 'volume_name': 'volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67eff492-3a49-4569-b75d-1b41d826536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67eff492-3a49-4569-b75d-1b41d826536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f63d94-1b70-437a-8b54-e07925f6ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Volume ba6c7086-25f6-4aa8-9dd6-913469d84a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87', 'volume_size': 1} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2108868707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6c7086-25f6-4aa8-9dd6-913469d84a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Creating volume ba6c7086-25f6-4aa8-9dd6-913469d84a87 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:07 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:07 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 1073741824 Apr 13 14:23:07 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (334df1f1-f5ee-46b8-a7fd-42c79764fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b55c3e9-8c7e-4175-8159-e2772f9ac12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b55c3e9-8c7e-4175-8159-e2772f9ac12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1324523030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d8abce-ac84-41c1-9c19-ba69d1f4490d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e950ee2a506c4e1985124c70bcdd8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='a14cca91eb30453894a2e9be975c2104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea161e81-5f45-4e1c-96a7-a83044843430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea161e81-5f45-4e1c-96a7-a83044843430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b84df8c-aa4b-4914-b6b9-9653f5130841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b84df8c-aa4b-4914-b6b9-9653f5130841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d8abce-ac84-41c1-9c19-ba69d1f4490d', 'volume_name': 'volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dff2b4f-300b-447a-9dd7-fab51afd4f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dff2b4f-300b-447a-9dd7-fab51afd4f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10150652-fee7-4779-aca6-dafb9024b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Volume 35d8abce-ac84-41c1-9c19-ba69d1f4490d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d', 'volume_size': 1} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (402fdb28-f1d8-4aff-ac4f-715a70a4b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b670c8-3cc5-4858-9f54-8fbf690e88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b670c8-3cc5-4858-9f54-8fbf690e88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448400881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f15afdd-f6d5-4deb-8590-b7c510f0b6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb6b036-6fcd-4f5b-a0f3-1eb695b4ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb6b036-6fcd-4f5b-a0f3-1eb695b4ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71807a44-0211-4f2e-ac65-9f4c27e2c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:07 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71807a44-0211-4f2e-ac65-9f4c27e2c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f15afdd-f6d5-4deb-8590-b7c510f0b6a0', 'volume_name': 'volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d90d87-ff31-431d-8eb0-b1decd0aa6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d90d87-ff31-431d-8eb0-b1decd0aa6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374415df-6e23-415d-b0ff-616eaff7329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume 4f15afdd-f6d5-4deb-8590-b7c510f0b6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0', 'volume_size': 1} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (feccf813-e224-4a55-b517-9b0f1409a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c17bb8c-a1b9-487b-8646-f8ead2954b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c17bb8c-a1b9-487b-8646-f8ead2954b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913678769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b67e95d-d7d2-49f4-8dee-ad8d26038bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33877cd-81b8-4b1c-97fe-4048694fda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33877cd-81b8-4b1c-97fe-4048694fda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b39fb67-79ed-4750-92b5-302d7be09a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b39fb67-79ed-4750-92b5-302d7be09a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b67e95d-d7d2-49f4-8dee-ad8d26038bed', 'volume_name': 'volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa9fb8c-3e39-40c2-898e-4f1348b4b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa9fb8c-3e39-40c2-898e-4f1348b4b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dbddf4-6a43-4539-afa4-0d6d9274eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Volume 7b67e95d-d7d2-49f4-8dee-ad8d26038bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed', 'volume_size': 1} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (095b0804-fab9-4c18-b920-0b07d5edc491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d54dde-fe01-48bd-8ea7-8a0709c1138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d54dde-fe01-48bd-8ea7-8a0709c1138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523942695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f981394-f514-4af8-b923-e80dbd01e18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe900a-0d38-488a-a693-f11e9029b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe900a-0d38-488a-a693-f11e9029b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148a0f82-9b94-430e-b930-d0058a410167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148a0f82-9b94-430e-b930-d0058a410167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f981394-f514-4af8-b923-e80dbd01e18f', 'volume_name': 'volume-5f981394-f514-4af8-b923-e80dbd01e18f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05e8a2d-82d8-41bf-9c70-d315760e2a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05e8a2d-82d8-41bf-9c70-d315760e2a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb65029-b056-4db2-8b8a-ce5051d2c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Volume 5f981394-f514-4af8-b923-e80dbd01e18f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f981394-f514-4af8-b923-e80dbd01e18f', 'volume_size': 1} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:08 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 1073741824" returned: 0 in 0.711s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:08 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 Apr 13 14:23:08 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (ff1773a2-5d6a-4b7d-aaa9-004d4214c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73354c6-701f-457b-8554-f6210580a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73354c6-701f-457b-8554-f6210580a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250536438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07006878-875e-4af7-a01e-a8bf358657a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725ae264-f048-4214-ac4b-366145275ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725ae264-f048-4214-ac4b-366145275ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a482026d-9dec-40ca-8e6d-e7a1f6b36998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a482026d-9dec-40ca-8e6d-e7a1f6b36998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07006878-875e-4af7-a01e-a8bf358657a3', 'volume_name': 'volume-07006878-875e-4af7-a01e-a8bf358657a3', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e269f1-e8c7-4b69-b273-3d473c377fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e269f1-e8c7-4b69-b273-3d473c377fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886669a6-0ccd-4b1b-952a-6654ceb99dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Volume 07006878-875e-4af7-a01e-a8bf358657a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07006878-875e-4af7-a01e-a8bf358657a3', 'volume_size': 1} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (4add0aee-c6c4-4be3-aefc-e087421b40e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cff7d4-ef22-40d7-aae8-46d218d552fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cff7d4-ef22-40d7-aae8-46d218d552fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-339951933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0779acaf-8da6-42a3-baaa-8c332925de45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:09Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad00a0e-78d2-4178-8224-9f221a00d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad00a0e-78d2-4178-8224-9f221a00d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b8442f-c6f3-46f1-8a14-2d7751a45f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b8442f-c6f3-46f1-8a14-2d7751a45f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0779acaf-8da6-42a3-baaa-8c332925de45', 'volume_name': 'volume-0779acaf-8da6-42a3-baaa-8c332925de45', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d017df-f39b-4dba-95b0-535c89dd60f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d017df-f39b-4dba-95b0-535c89dd60f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450c191a-13c4-4b8a-b26d-93ad84d5a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:08 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Volume 0779acaf-8da6-42a3-baaa-8c332925de45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0779acaf-8da6-42a3-baaa-8c332925de45', 'volume_size': 1} Apr 13 14:23:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:09 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87" returned: 0 in 0.579s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1324523030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d8abce-ac84-41c1-9c19-ba69d1f4490d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e950ee2a506c4e1985124c70bcdd8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='a14cca91eb30453894a2e9be975c2104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Creating volume 35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:09 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f63d94-1b70-437a-8b54-e07925f6ea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:09 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d 1073741824 Apr 13 14:23:09 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8051c8b8-61fc-4310-b2e7-b91ea2e734fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:09 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Volume volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 (ba6c7086-25f6-4aa8-9dd6-913469d84a87): created successfully Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8051c8b8-61fc-4310-b2e7-b91ea2e734fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (fe7d4e32-eebb-4e9b-bef6-1a94ef8c7490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:09 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f0850b24-e490-4f89-9aec-3ce69fbef31b tempest-CreateVolumesFromImageTest-1875009281 None] Created volume successfully. Apr 13 14:23:09 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d 1073741824" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:09 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:09 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:10 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.490s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448400881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f15afdd-f6d5-4deb-8590-b7c510f0b6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Creating volume 4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:10 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10150652-fee7-4779-aca6-dafb9024b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:10 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 1073741824 Apr 13 14:23:10 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3720f189-fbca-439c-8684-60a78dad0370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:10 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Volume volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d (35d8abce-ac84-41c1-9c19-ba69d1f4490d): created successfully Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3720f189-fbca-439c-8684-60a78dad0370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (334df1f1-f5ee-46b8-a7fd-42c79764fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:10 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5baefcfb-8453-4177-8a52-36c3d007fc74 tempest-VolumeDependencyTests-632912676 None] Created volume successfully. Apr 13 14:23:10 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 1073741824" returned: 0 in 0.492s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:10 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:10 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 Apr 13 14:23:10 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:11 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0" returned: 0 in 0.425s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.906s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913678769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b67e95d-d7d2-49f4-8dee-ad8d26038bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Creating volume 7b67e95d-d7d2-49f4-8dee-ad8d26038bed {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:11 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374415df-6e23-415d-b0ff-616eaff7329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c15e96-7b87-4aeb-9357-88c39c1b0b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:11 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed 1073741824 Apr 13 14:23:11 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:11 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 (4f15afdd-f6d5-4deb-8590-b7c510f0b6a0): created successfully Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c15e96-7b87-4aeb-9357-88c39c1b0b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (402fdb28-f1d8-4aff-ac4f-715a70a4b68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:11 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-4731e1a1-0a86-41e4-9bb0-24d765c0bb4e tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created volume successfully. Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:11 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed 1073741824" returned: 0 in 0.603s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:11 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:11 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed Apr 13 14:23:11 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:12 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed" returned: 0 in 0.514s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.845s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523942695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f981394-f514-4af8-b923-e80dbd01e18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Creating volume 5f981394-f514-4af8-b923-e80dbd01e18f {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:12 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:12 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f 1073741824 Apr 13 14:23:12 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dbddf4-6a43-4539-afa4-0d6d9274eb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13288a18-4119-47c0-a620-87094f50a0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Volume volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed (7b67e95d-d7d2-49f4-8dee-ad8d26038bed): created successfully Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13288a18-4119-47c0-a620-87094f50a0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (feccf813-e224-4a55-b517-9b0f1409a98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:12 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-eb410bfc-3cbd-4f25-9cc0-9b25e3df01d9 tempest-CreateVolumesFromImageTest-1875009281 None] Created volume successfully. Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (8cb983a6-9991-406b-a782-00cf5e59211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6bd8c7-4d98-4e28-bb5e-c6f2ce95c4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6bd8c7-4d98-4e28-bb5e-c6f2ce95c4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789032653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86ed0e-9a72-42d9-ac46-7536ff7db758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:12Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06320928-798d-4416-82ef-ecfad47988f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06320928-798d-4416-82ef-ecfad47988f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e496b0d0-de3c-4c2a-afe0-6dba6b2a7708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e496b0d0-de3c-4c2a-afe0-6dba6b2a7708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b86ed0e-9a72-42d9-ac46-7536ff7db758', 'volume_name': 'volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3550a146-502f-431e-b7a2-8df6e8ee0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3550a146-502f-431e-b7a2-8df6e8ee0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f5b8c3-bf14-4a7d-9145-41db924e32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume 2b86ed0e-9a72-42d9-ac46-7536ff7db758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758', 'volume_size': 1} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:12 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (c1ac01ab-9df7-4745-869f-8d46e34a9a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5caa92-a48c-4683-bc7f-f16037b5a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f 1073741824" returned: 0 in 0.559s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5caa92-a48c-4683-bc7f-f16037b5a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440803526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ebebbb-f0eb-42b7-8189-517c30f756b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d7d44c-f8ed-43bc-97f5-5e37511b8c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d7d44c-f8ed-43bc-97f5-5e37511b8c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a43821f-ef65-4cab-a8c7-d945c37f47c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a43821f-ef65-4cab-a8c7-d945c37f47c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ebebbb-f0eb-42b7-8189-517c30f756b7', 'volume_name': 'volume-88ebebbb-f0eb-42b7-8189-517c30f756b7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ab171b-f9c3-4b17-87d8-a9f036103a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ab171b-f9c3-4b17-87d8-a9f036103a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732bfe19-6bfc-4e6f-ace8-118b2012cc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:12 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume 88ebebbb-f0eb-42b7-8189-517c30f756b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ebebbb-f0eb-42b7-8189-517c30f756b7', 'volume_size': 1} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:12 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:12 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f Apr 13 14:23:12 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (3e9f3023-22d0-4251-b35b-e808bd4b175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e30401-eb00-46d5-9f13-4b324ff074a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e30401-eb00-46d5-9f13-4b324ff074a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801714735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfcee4b-565c-4134-9001-6b35b1c551da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfcee4b-565c-4134-9001-6b35b1c551da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d52bd-e096-4c7d-8e10-579deca0f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d52bd-e096-4c7d-8e10-579deca0f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62', 'volume_name': 'volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8feb4b8-d87a-4053-a4ae-942632f9d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8feb4b8-d87a-4053-a4ae-942632f9d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515676dd-f4d5-4309-9774-336b2641e57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume 3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62', 'volume_size': 1} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (2920267e-f8be-4bf9-a5ba-61735bb4c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c70ce1c-e5ab-42de-adda-c390bb8afbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c70ce1c-e5ab-42de-adda-c390bb8afbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439895147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e817d35-d19b-4049-a1bc-7b6fc25dd976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ccfe861-91ab-440e-9329-cfdb46f62aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ccfe861-91ab-440e-9329-cfdb46f62aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28b1a09-6c65-4642-87e6-3755df0b86dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28b1a09-6c65-4642-87e6-3755df0b86dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e817d35-d19b-4049-a1bc-7b6fc25dd976', 'volume_name': 'volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc1a0ff-413c-48cc-8647-26c79456ffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc1a0ff-413c-48cc-8647-26c79456ffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22eef066-bd2e-4a43-a3c4-259b2a445155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume 7e817d35-d19b-4049-a1bc-7b6fc25dd976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976', 'volume_size': 1} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:13 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f" returned: 0 in 0.598s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.807s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250536438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07006878-875e-4af7-a01e-a8bf358657a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:08Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Creating volume 07006878-875e-4af7-a01e-a8bf358657a3 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:13 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb65029-b056-4db2-8b8a-ce5051d2c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f981394-f514-4af8-b923-e80dbd01e18f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28911cb-148d-4d64-b64e-9335ffc694ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 1073741824 Apr 13 14:23:13 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Volume volume-5f981394-f514-4af8-b923-e80dbd01e18f (5f981394-f514-4af8-b923-e80dbd01e18f): created successfully Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28911cb-148d-4d64-b64e-9335ffc694ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (095b0804-fab9-4c18-b920-0b07d5edc491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:13 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-35b4774d-529d-48a1-a741-5a23875b3d50 tempest-CreateVolumesFromImageTest-1875009281 None] Created volume successfully. Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (84df2aeb-dd45-40bb-b358-6f5c35012cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580702a7-a530-45a8-946d-9b9b22358dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580702a7-a530-45a8-946d-9b9b22358dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247108279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277f7f2a-0b47-444f-9eb6-13cf59f74068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277f7f2a-0b47-444f-9eb6-13cf59f74068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23522eba-0a52-47de-a2aa-71850d130fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23522eba-0a52-47de-a2aa-71850d130fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463', 'volume_name': 'volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5eca6a-7af8-4a59-8b19-8329424e3db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5eca6a-7af8-4a59-8b19-8329424e3db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af2a876-2c42-4b2e-b820-37a3fc489a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:13 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463', 'volume_size': 1} Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:13 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:13 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 1073741824" returned: 0 in 0.551s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:14 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 Apr 13 14:23:14 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:14 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3" returned: 0 in 0.434s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.683s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-339951933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0779acaf-8da6-42a3-baaa-8c332925de45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7420fa26a34ebbb4122ac437776b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:09Z,use_quota=True,user_id='4eb8cc03ece347b9b7338b72a2629f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Creating volume 0779acaf-8da6-42a3-baaa-8c332925de45 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:14 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886669a6-0ccd-4b1b-952a-6654ceb99dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07006878-875e-4af7-a01e-a8bf358657a3', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5797ad94-31e5-4987-a2d7-15887c809a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:14 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Volume volume-07006878-875e-4af7-a01e-a8bf358657a3 (07006878-875e-4af7-a01e-a8bf358657a3): created successfully Apr 13 14:23:14 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 1073741824 Apr 13 14:23:14 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5797ad94-31e5-4987-a2d7-15887c809a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (ff1773a2-5d6a-4b7d-aaa9-004d4214c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:14 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9c3fcfab-45b6-48ec-8969-2b7adb9982fd tempest-CreateVolumesFromImageTest-1875009281 None] Created volume successfully. Apr 13 14:23:14 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:14 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 1073741824" returned: 0 in 0.531s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:15 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 Apr 13 14:23:15 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:15 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45" returned: 0 in 0.445s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.226s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450c191a-13c4-4b8a-b26d-93ad84d5a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0779acaf-8da6-42a3-baaa-8c332925de45', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7d0aaf-c473-4f4c-ae35-25d173477120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Creating offline snapshot a1dcae0a-0e5d-45c7-b588-b43a064eeb74 of volume 35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:23:15 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Volume volume-0779acaf-8da6-42a3-baaa-8c332925de45 (0779acaf-8da6-42a3-baaa-8c332925de45): created successfully Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7d0aaf-c473-4f4c-ae35-25d173477120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Flow 'volume_create_manager' (4add0aee-c6c4-4be3-aefc-e087421b40e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde552ac-2f31-497e-8d49-ad5e9c6c84bd]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:15 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:15 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-9bcc4451-fa92-456b-8d1f-d365e814ef27 tempest-CreateVolumesFromImageTest-1875009281 None] Created volume successfully. Apr 13 14:23:15 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:15 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:16 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.545s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:16 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 1G Apr 13 14:23:16 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-0779acaf-8da6-42a3-baaa-8c332925de45-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-0779acaf-8da6-42a3-baaa-8c332925de45-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-quobyte-0779acaf-8da6-42a3-baaa-8c332925de45" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-0779acaf-8da6-42a3-baaa-8c332925de45" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bfcdfd-fa14-4590-9397-04c24ccf1c6b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:16 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 Apr 13 14:23:16 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:16 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 1G" returned: 0 in 0.554s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:16 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 Apr 13 14:23:16 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:16 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45" returned: 0 in 0.517s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:16 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:16 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45 Apr 13 14:23:16 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:17 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74" returned: 0 in 0.535s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:17 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 is being set with open permissions: ugo+rw Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:17 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 Apr 13 14:23:17 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:17 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-0779acaf-8da6-42a3-baaa-8c332925de45" returned: 0 in 0.427s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-0779acaf-8da6-42a3-baaa-8c332925de45" released by "delete_volume" :: held 0.974s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Created reservations ['f659cf11-a803-4893-91f3-8f1041366dfd', 'b0373346-4a02-4596-8683-e4fd88f138ed', '134aaea4-42a3-46ae-b097-ea197249cbe7', 'e5fcf6c5-1f75-4d57-8c3a-5044f765f32d'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:17 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:17 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-07006878-875e-4af7-a01e-a8bf358657a3-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-07006878-875e-4af7-a01e-a8bf358657a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-quobyte-07006878-875e-4af7-a01e-a8bf358657a3" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-07006878-875e-4af7-a01e-a8bf358657a3" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:17 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b622acd-ade7-458e-981b-cfca5e2fda93]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74" returned: 0 in 0.499s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:17 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info Apr 13 14:23:17 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:17 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 Apr 13 14:23:17 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:17 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.497s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:17 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Deleted volume successfully. Apr 13 14:23:17 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3c4a9515-2620-4a12-a98c-6e8a44f375ff tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-0779acaf-8da6-42a3-baaa-8c332925de45-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:18 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info" returned: 0 in 0.511s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:18 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info is being set with open permissions: ugo+rw Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:18 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info Apr 13 14:23:18 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:18 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3" returned: 0 in 0.568s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:18 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3 Apr 13 14:23:18 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:18 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.info" returned: 0 in 0.428s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.160s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.095s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789032653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86ed0e-9a72-42d9-ac46-7536ff7db758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:12Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Creating volume 2b86ed0e-9a72-42d9-ac46-7536ff7db758 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:18 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:18 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 1073741824 Apr 13 14:23:18 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:18 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-af191941-891a-4772-ba6a-2dfb3ddf178f tempest-VolumeDependencyTests-632912676 None] Create snapshot completed successfully Apr 13 14:23:18 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-07006878-875e-4af7-a01e-a8bf358657a3" returned: 0 in 0.479s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-07006878-875e-4af7-a01e-a8bf358657a3" released by "delete_volume" :: held 1.073s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Created reservations ['6450654e-c882-4261-a27e-f702d53b4edd', 'c67cbeaa-009d-4a12-a0ae-f03aa4562f6d', 'bf1ccf98-1469-49ac-a140-2207371791d6', '68531ee6-7fb3-4a73-a432-d6d05166759a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:18 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:18 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:18 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:19 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 1073741824" returned: 0 in 0.541s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:19 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.445s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Deleted volume successfully. Apr 13 14:23:19 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 Apr 13 14:23:19 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ad77d160-e9f2-4cb3-938c-fba7fe226b11 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-07006878-875e-4af7-a01e-a8bf358657a3-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_service.periodic_task [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:19 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:19 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:19 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758" returned: 0 in 0.545s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.948s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440803526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ebebbb-f0eb-42b7-8189-517c30f756b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Creating volume 88ebebbb-f0eb-42b7-8189-517c30f756b7 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:19 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f5b8c3-bf14-4a7d-9145-41db924e32b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0aba913-83e7-44dd-a6c2-1682b5ee8c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:19 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 1073741824 Apr 13 14:23:19 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-5f981394-f514-4af8-b923-e80dbd01e18f-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:19 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 (2b86ed0e-9a72-42d9-ac46-7536ff7db758): created successfully Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0aba913-83e7-44dd-a6c2-1682b5ee8c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (8cb983a6-9991-406b-a782-00cf5e59211a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:19 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-18e3ba7e-4325-4980-bba7-ba553ebee354 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created volume successfully. Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-5f981394-f514-4af8-b923-e80dbd01e18f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (0cbd73fb-59be-4558-9757-05b52a03e767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab691e4-bf6a-47a2-9c72-92ed52222f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-quobyte-5f981394-f514-4af8-b923-e80dbd01e18f" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab691e4-bf6a-47a2-9c72-92ed52222f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-458117476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8a522c-3b6f-4bd0-b383-88839b091863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e950ee2a506c4e1985124c70bcdd8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1dcae0a-0e5d-45c7-b588-b43a064eeb74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:20Z,use_quota=True,user_id='a14cca91eb30453894a2e9be975c2104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2f4dac-ad10-45a8-9e02-f0e0abef9627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2f4dac-ad10-45a8-9e02-f0e0abef9627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cec09b-60d5-4eb2-affd-f395a029c77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cec09b-60d5-4eb2-affd-f395a029c77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc8a522c-3b6f-4bd0-b383-88839b091863', 'volume_name': 'volume-cc8a522c-3b6f-4bd0-b383-88839b091863', 'volume_size': 1, 'snapshot_id': 'a1dcae0a-0e5d-45c7-b588-b43a064eeb74'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:19 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27b2434-13f0-4d09-add9-7f5ac174918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27b2434-13f0-4d09-add9-7f5ac174918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee66e657-9ad4-4397-8083-31d05aa0a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:20 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Volume cc8a522c-3b6f-4bd0-b383-88839b091863: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc8a522c-3b6f-4bd0-b383-88839b091863', 'volume_size': 1, 'snapshot_id': 'a1dcae0a-0e5d-45c7-b588-b43a064eeb74'} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-5f981394-f514-4af8-b923-e80dbd01e18f" acquired by "delete_volume" :: waited 0.047s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de19bb8-b645-4e4d-9cdf-67d6d30db2c6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:20 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f Apr 13 14:23:20 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:20 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.588s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-38887a94-3a47-4e29-b9a9-763349641990 None None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:20 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 1073741824" returned: 0 in 0.884s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:20 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f" returned: 0 in 0.644s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:20 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:20 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 Apr 13 14:23:20 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:20 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f Apr 13 14:23:20 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:21 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.069s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801714735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Creating volume 3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:21 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732bfe19-6bfc-4e6f-ace8-118b2012cc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ebebbb-f0eb-42b7-8189-517c30f756b7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c4d222-e42a-4f3f-9c24-cb774562be11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:21 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 1073741824 Apr 13 14:23:21 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 (88ebebbb-f0eb-42b7-8189-517c30f756b7): created successfully Apr 13 14:23:21 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c4d222-e42a-4f3f-9c24-cb774562be11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (c1ac01ab-9df7-4745-869f-8d46e34a9a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-96d43d68-defa-4dc0-8c4b-b6bd9a04c908 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created volume successfully. Apr 13 14:23:21 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-5f981394-f514-4af8-b923-e80dbd01e18f" returned: 0 in 0.573s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-5f981394-f514-4af8-b923-e80dbd01e18f" released by "delete_volume" :: held 1.242s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Created reservations ['e2d13604-9320-451f-9238-2e18d495e850', '1dfe59d0-3c85-4841-95de-502b8fc5fa47', '0f539a04-8597-4e8a-b90a-093994a2b64b', '605ef70a-4c24-403d-a858-30072d7aa4f8'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:21 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:21 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:21 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 1073741824" returned: 0 in 0.594s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:21 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 Apr 13 14:23:21 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:21 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.482s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:21 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Deleted volume successfully. Apr 13 14:23:21 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c9f862f7-5a39-4eda-adee-0f752315e6a6 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-5f981394-f514-4af8-b923-e80dbd01e18f-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-7b67e95d-d7d2-49f4-8dee-ad8d26038bed-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-7b67e95d-d7d2-49f4-8dee-ad8d26038bed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-quobyte-7b67e95d-d7d2-49f4-8dee-ad8d26038bed" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-7b67e95d-d7d2-49f4-8dee-ad8d26038bed" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[662a1a39-0265-400b-aaea-8bc15328f1e0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:22 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed Apr 13 14:23:22 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:22 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.024s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439895147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e817d35-d19b-4049-a1bc-7b6fc25dd976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Creating volume 7e817d35-d19b-4049-a1bc-7b6fc25dd976 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:22 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515676dd-f4d5-4309-9774-336b2641e57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f990ca6-3b33-405d-a504-835711f4ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:22 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 (3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62): created successfully Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f990ca6-3b33-405d-a504-835711f4ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (3e9f3023-22d0-4251-b35b-e808bd4b175f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:22 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 1073741824 Apr 13 14:23:22 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:22 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-dabaa05e-15a9-46ae-bd91-a3ec45af4a6b tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created volume successfully. Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Flow 'volume_create_manager' (200ce77b-7673-4001-ae32-777ac4b9f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52da9733-d0f8-4856-9774-9e2ce374781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:22 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52da9733-d0f8-4856-9774-9e2ce374781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-281088732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932f1cb5-7748-4d48-8c61-01012ed5a9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8586e4cf691e45e08890217e821caa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:23Z,use_quota=True,user_id='33f806dd1d42430da952ee189c040bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338f328c-6b30-4fde-8ffd-979e18aeae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338f328c-6b30-4fde-8ffd-979e18aeae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b3e33c-2bef-41e0-8434-126862d1a700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b3e33c-2bef-41e0-8434-126862d1a700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932f1cb5-7748-4d48-8c61-01012ed5a9cd', 'volume_name': 'volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0d79cb-7353-46d2-8b21-c16cf43ae1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0d79cb-7353-46d2-8b21-c16cf43ae1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c481e7fe-3a47-4488-b81c-153181a0d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:22 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Volume 932f1cb5-7748-4d48-8c61-01012ed5a9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd', 'volume_size': 1} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed" returned: 0 in 0.574s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:22 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed Apr 13 14:23:22 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:22 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 1073741824" returned: 0 in 0.561s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:22 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:22 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 Apr 13 14:23:22 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:23 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7b67e95d-d7d2-49f4-8dee-ad8d26038bed" returned: 0 in 0.508s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-7b67e95d-d7d2-49f4-8dee-ad8d26038bed" released by "delete_volume" :: held 1.107s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Created reservations ['67bbf3f5-c580-4c42-9c44-865fe90188f5', 'ac0f224e-ab54-41e4-96f3-3d6de103341e', 'b6c8aefa-365c-403e-9dd8-482f5bfc5113', '901d5ad7-8845-4775-a4b7-6c3b8de2df13'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:23 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:23 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:23 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.868s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247108279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1c1b7f94aa4f878aa769e69c4edc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:13Z,use_quota=True,user_id='a7e0b000d2d341ec84167060d716a237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Creating volume e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:23 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22eef066-bd2e-4a43-a3c4-259b2a445155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6bb177-3163-4880-9855-58ccaa7fae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:23 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 1073741824 Apr 13 14:23:23 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:23 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 (7e817d35-d19b-4049-a1bc-7b6fc25dd976): created successfully Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6bb177-3163-4880-9855-58ccaa7fae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (2920267e-f8be-4bf9-a5ba-61735bb4c984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-43dd8a1e-fe4e-4288-85ae-49e9960b3a5a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created volume successfully. Apr 13 14:23:23 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.398s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:23 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Deleted volume successfully. Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ec42511-2e9e-490e-b729-0263b5657944 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-7b67e95d-d7d2-49f4-8dee-ad8d26038bed-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:23 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 1073741824" returned: 0 in 0.499s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:23 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:23 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 Apr 13 14:23:24 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-ba6c7086-25f6-4aa8-9dd6-913469d84a87-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-ba6c7086-25f6-4aa8-9dd6-913469d84a87-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "cinder-quobyte-ba6c7086-25f6-4aa8-9dd6-913469d84a87" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-ba6c7086-25f6-4aa8-9dd6-913469d84a87" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[775c77b8-3dd6-47b5-b80f-4e6629a8bbd5]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:24 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463" returned: 0 in 0.433s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.396s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-a1dcae0a-0e5d-45c7-b588-b43a064eeb74-cc8a522c-3b6f-4bd0-b383-88839b091863" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af2a876-2c42-4b2e-b820-37a3fc489a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713cd778-997b-4006-a02c-eed07efe06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:24 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Volume volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 (e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463): created successfully Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713cd778-997b-4006-a02c-eed07efe06bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Flow 'volume_create_manager' (84df2aeb-dd45-40bb-b358-6f5c35012cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-a1dcae0a-0e5d-45c7-b588-b43a064eeb74-cc8a522c-3b6f-4bd0-b383-88839b091863" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Creating volume cc8a522c-3b6f-4bd0-b383-88839b091863 from snapshot a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:24 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-cc8a522c-3b6f-4bd0-b383-88839b091863" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:24 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:24 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b26dc5d2-bab5-4b98-908b-0191cdb2556a tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created volume successfully. Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-cc8a522c-3b6f-4bd0-b383-88839b091863" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] snapshot: a1dcae0a-0e5d-45c7-b588-b43a064eeb74, volume: cc8a522c-3b6f-4bd0-b383-88839b091863, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a521f68d-53f7-4558-9321-2cfe2b1c24e0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:24 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 Apr 13 14:23:24 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:24 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87" returned: 0 in 0.478s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:24 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87 Apr 13 14:23:24 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:24 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74" returned: 0 in 0.487s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a86ce2-aba5-416b-96f5-e7dc0f820535]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:24 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:25 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:25 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:25 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ba6c7086-25f6-4aa8-9dd6-913469d84a87" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-quobyte-ba6c7086-25f6-4aa8-9dd6-913469d84a87" released by "delete_volume" :: held 0.914s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Created reservations ['aa266fd1-4c68-4f27-8c9e-2718d3afdd62', 'd0a088ed-0185-451b-aadc-bbd6eb215006', '995f0510-d7b4-4c59-8962-d0c8b598676d', '9002650d-ba86-4339-8d5c-247aee7f39dd'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:25 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:25 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:25 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.558s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:25 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 Apr 13 14:23:25 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-quobyte-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[154298b2-a1a5-4d64-9fbd-f18a0b5f1ec4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:25 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 Apr 13 14:23:25 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:25 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.539s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:25 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Deleted volume successfully. Apr 13 14:23:25 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fb4fee27-4d17-499b-a4ff-588e3a3fad29 tempest-CreateVolumesFromImageTest-1875009281 None] Lock "cinder-ba6c7086-25f6-4aa8-9dd6-913469d84a87-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:26 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463" returned: 0 in 0.590s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:26 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:26 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463 Apr 13 14:23:26 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:27 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463" returned: 0 in 1.150s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463" released by "delete_volume" :: held 1.780s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created reservations ['9e23adfc-9ab9-4c1d-b5c5-17eb493750bd', '5973f8e6-edce-4b82-a290-351f85f98e7c', '436c2d48-d09f-4d38-8aed-1317dcc253c5', 'd94772a5-bfcd-45f1-9808-6408296bc40c'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:27 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:27 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-7e817d35-d19b-4049-a1bc-7b6fc25dd976-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:27 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-7e817d35-d19b-4049-a1bc-7b6fc25dd976-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-quobyte-7e817d35-d19b-4049-a1bc-7b6fc25dd976" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-7e817d35-d19b-4049-a1bc-7b6fc25dd976" acquired by "delete_volume" :: waited 0.021s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f79a33-af6a-444a-9457-a286858d389c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:28 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863" returned: 0 in 2.592s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[356716da-754c-4e78-9948-ebfda82cf0ac]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:28 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 Apr 13 14:23:28 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:28 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:28 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:28 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.861s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:28 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Deleted volume successfully. Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ee6f210b-793a-42d2-9e14-c4e2e6a34812 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-e2ec04e6-9a8c-4e9c-9bc4-dd59d2ce4463-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (0962a21c-eb24-4096-b103-7ae6156795f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f370670-41e9-44f6-86d3-e8ad5af29aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f370670-41e9-44f6-86d3-e8ad5af29aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47398251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcc2e2a-08e7-4802-862b-d9c40393c5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:29Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abe1eea-0d45-41e5-b5d5-2bc2847f482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abe1eea-0d45-41e5-b5d5-2bc2847f482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f99d858-b20b-4076-8bc9-c1c71e369033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f99d858-b20b-4076-8bc9-c1c71e369033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dcc2e2a-08e7-4802-862b-d9c40393c5d5', 'volume_name': 'volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f912fb56-c241-409f-959c-4825d9e66639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f912fb56-c241-409f-959c-4825d9e66639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1722895c-53ff-4d54-9a3d-d61243ac6487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:28 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume 8dcc2e2a-08e7-4802-862b-d9c40393c5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5', 'volume_size': 1} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:28 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976" returned: 0 in 0.549s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:28 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976 Apr 13 14:23:28 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:28 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.709s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:23:28 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Converted 1024.00 MB image at 394.87 MB/s Apr 13 14:23:28 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 is being set with open permissions: ugo+rw Apr 13 14:23:28 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:28 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 Apr 13 14:23:28 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:29 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7e817d35-d19b-4049-a1bc-7b6fc25dd976" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-7e817d35-d19b-4049-a1bc-7b6fc25dd976" released by "delete_volume" :: held 1.040s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created reservations ['ee17ddf2-d7d2-4104-bc09-1692aa8e0d9b', '987f2885-1b10-43f5-9fa2-77e6d8383b85', '4e8de254-906c-41b6-bce4-e131ad09b1a1', 'fbb2f395-58ae-4199-a8ff-8bceca30d83a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:29 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:29 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:29 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-cc8a522c-3b6f-4bd0-b383-88839b091863" released by "_copy_volume_from_snapshot" :: held 4.886s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-a1dcae0a-0e5d-45c7-b588-b43a064eeb74-cc8a522c-3b6f-4bd0-b383-88839b091863" released by "_create_volume_from_snapshot" :: held 4.903s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.933s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.607s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-281088732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932f1cb5-7748-4d48-8c61-01012ed5a9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8586e4cf691e45e08890217e821caa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:23Z,use_quota=True,user_id='33f806dd1d42430da952ee189c040bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Creating volume 932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:29 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:29 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd 1073741824 Apr 13 14:23:29 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee66e657-9ad4-4397-8083-31d05aa0a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8a522c-3b6f-4bd0-b383-88839b091863', 'volume_size': 1, 'snapshot_id': 'a1dcae0a-0e5d-45c7-b588-b43a064eeb74'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1efc41d-9099-448d-a9bc-0fe2b03b2a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:29 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Volume volume-cc8a522c-3b6f-4bd0-b383-88839b091863 (cc8a522c-3b6f-4bd0-b383-88839b091863): created successfully Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1efc41d-9099-448d-a9bc-0fe2b03b2a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (0cbd73fb-59be-4558-9757-05b52a03e767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bb306ccc-306c-40fa-9c33-8d421148a26b tempest-VolumeDependencyTests-632912676 None] Created volume successfully. Apr 13 14:23:29 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.456s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:29 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Deleted volume successfully. Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-01d62b4b-078b-417b-8e71-6646896e71f3 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-7e817d35-d19b-4049-a1bc-7b6fc25dd976-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:29 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd 1073741824" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:29 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:29 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:29 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-quobyte-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62" acquired by "delete_volume" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ef877-5574-4a72-b7c6-8699ece65aac]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:30 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 Apr 13 14:23:30 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:30 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.450s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47398251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcc2e2a-08e7-4802-862b-d9c40393c5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:29Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating volume 8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:30 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c481e7fe-3a47-4488-b81c-153181a0d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaebce2-88ea-48a4-831e-623b699b4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:30 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 1073741824 Apr 13 14:23:30 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:30 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Volume volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd (932f1cb5-7748-4d48-8c61-01012ed5a9cd): created successfully Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaebce2-88ea-48a4-831e-623b699b4f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Flow 'volume_create_manager' (200ce77b-7673-4001-ae32-777ac4b9f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:30 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3c6e940a-d320-4f4b-b911-7c966ba5cb78 tempest-SnapshotDependencyTests-2128198150 None] Created volume successfully. Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-a1dcae0a-0e5d-45c7-b588-b43a064eeb74-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Lock "cinder-a1dcae0a-0e5d-45c7-b588-b43a064eeb74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-35d8abce-ac84-41c1-9c19-ba69d1f4490d" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-35d8abce-ac84-41c1-9c19-ba69d1f4490d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-a1dcae0a-0e5d-45c7-b588-b43a064eeb74" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-a1dcae0a-0e5d-45c7-b588-b43a064eeb74" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Deleting offline snapshot a1dcae0a-0e5d-45c7-b588-b43a064eeb74 of volume 35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] snapshot_file for this snap is: volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b483c58-dd69-4fcf-a592-163639fb1082]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:30 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 Apr 13 14:23:30 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:30 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62" returned: 0 in 0.585s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:30 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62 Apr 13 14:23:30 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:30 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 1073741824" returned: 0 in 0.581s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:30 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:30 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 Apr 13 14:23:30 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:31 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74" returned: 0 in 0.528s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e525b544-8a32-4f1d-b60d-522cbae400c4]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:31 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:31 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:31 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62" released by "delete_volume" :: held 1.075s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created reservations ['aa93c266-1713-4072-9688-d388eea82307', 'aa71144f-f9a3-4ea0-9468-1ac0ee8669a6', 'e9e7de99-f559-4943-8109-e6ea0ca0a6bb', '6ecafba1-5b74-4967-9e0b-cc641f8e885b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:31 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" returned: 0 in 0.459s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:31 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:31 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1722895c-53ff-4d54-9a3d-d61243ac6487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab78e88-64be-4402-9ce2-3f15736b09cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:31 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 (8dcc2e2a-08e7-4802-862b-d9c40393c5d5): created successfully Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab78e88-64be-4402-9ce2-3f15736b09cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (0962a21c-eb24-4096-b103-7ae6156795f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:31 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c0ed235b-7b6e-44d8-8a50-819d81bb04d9 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created volume successfully. Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Creating offline snapshot b6ce6996-c571-4f0f-8445-fea696391ce6 of volume 932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadd506-e39b-426a-ad34-f67b02eccc16]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:31 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:31 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:31 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.597s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:31 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 Apr 13 14:23:31 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:31 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:31 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Deleted volume successfully. Apr 13 14:23:31 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-289aed06-8983-418d-a904-440416c8706d tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-3ac7c0fd-5fa2-46c6-aa77-309e5dbb7a62-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:32 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.542s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:32 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 1G Apr 13 14:23:32 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:32 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74" returned: 0 in 0.510s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:32 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74 Apr 13 14:23:32 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-88ebebbb-f0eb-42b7-8189-517c30f756b7-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-88ebebbb-f0eb-42b7-8189-517c30f756b7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-quobyte-88ebebbb-f0eb-42b7-8189-517c30f756b7" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-88ebebbb-f0eb-42b7-8189-517c30f756b7" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[14458350-3c0f-4e11-91f6-c9d51152aa11]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:32 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 Apr 13 14:23:32 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:32 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 1G" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:32 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:32 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 Apr 13 14:23:32 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d.a1dcae0a-0e5d-45c7-b588-b43a064eeb74" returned: 0 in 0.441s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-a1dcae0a-0e5d-45c7-b588-b43a064eeb74" released by "_delete_snapshot" :: held 2.132s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-35d8abce-ac84-41c1-9c19-ba69d1f4490d" released by "delete_snapshot" :: held 2.144s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Created reservations ['014f85e4-1a55-42f3-bd5f-f5dda3dc6038', 'ece16ad2-2431-4cd3-ba57-86d78e51104c', '1bf7fa31-4914-4eab-bc1c-cd2473ae514f', '1b15e049-259d-4041-98e4-d6f882841125'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:32 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Delete snapshot completed successfully. Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-bf58de9b-e2d9-422d-8ac4-e185c64c1e1d tempest-VolumeDependencyTests-632912676 None] Lock "cinder-a1dcae0a-0e5d-45c7-b588-b43a064eeb74-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:32 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7" returned: 0 in 0.533s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:32 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:33 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7 Apr 13 14:23:33 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:33 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6" returned: 0 in 0.429s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:33 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 is being set with open permissions: ugo+rw Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:33 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 Apr 13 14:23:33 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:33 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6" returned: 0 in 0.399s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:33 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-88ebebbb-f0eb-42b7-8189-517c30f756b7" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-88ebebbb-f0eb-42b7-8189-517c30f756b7" released by "delete_volume" :: held 1.043s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:33 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info Apr 13 14:23:33 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created reservations ['42f83f6c-aabf-49be-af22-34743c6983e7', 'c8c8d23a-1453-4742-8787-653e878f4dea', '2c1db350-0510-4b55-900a-f51126f9c0e1', '3db92399-29fd-4b05-a423-edf24deeb156'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:33 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:33 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-35d8abce-ac84-41c1-9c19-ba69d1f4490d-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-35d8abce-ac84-41c1-9c19-ba69d1f4490d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-35d8abce-ac84-41c1-9c19-ba69d1f4490d" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-35d8abce-ac84-41c1-9c19-ba69d1f4490d" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee548b-7964-4987-9c90-1d1b8dc12805]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:33 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:33 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:33 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info" returned: 0 in 0.418s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:33 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info is being set with open permissions: ugo+rw Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:33 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info Apr 13 14:23:33 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:33 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.434s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:33 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:33 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Deleted volume successfully. Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-29cfa2b5-45dd-4ba9-adc3-02479833df65 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-88ebebbb-f0eb-42b7-8189-517c30f756b7-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:34 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.471s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:34 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d Apr 13 14:23:34 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:34 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.info" returned: 0 in 0.407s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.458s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating offline snapshot d89d769b-f46d-44a2-846c-f754b2edad5c of volume 8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:23:34 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-416de641-8fe6-42e8-96e3-34813ae1d7fc tempest-SnapshotDependencyTests-2128198150 None] Create snapshot completed successfully Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[42075ac5-3ef4-436e-a02d-a70953860360]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:34 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 Apr 13 14:23:34 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-2b86ed0e-9a72-42d9-ac46-7536ff7db758-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-2b86ed0e-9a72-42d9-ac46-7536ff7db758-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-quobyte-2b86ed0e-9a72-42d9-ac46-7536ff7db758" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-2b86ed0e-9a72-42d9-ac46-7536ff7db758" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ee55bf-504d-457f-aa73-7a521470053e]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:34 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-35d8abce-ac84-41c1-9c19-ba69d1f4490d" returned: 0 in 0.482s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-35d8abce-ac84-41c1-9c19-ba69d1f4490d" released by "delete_volume" :: held 0.992s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Created reservations ['55fad6cf-9d6a-4de8-9681-df25df431fb9', 'ca5bd7b1-c751-4b51-9bd3-73292538e550', 'a4553309-2be4-4f80-af3f-7e376888f6a7', '6981cfbd-7b1f-4bb0-8eb7-db309df4697a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:34 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 Apr 13 14:23:34 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:34 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:34 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:34 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" returned: 0 in 0.634s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:34 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:35 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c 1G Apr 13 14:23:35 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (d77e24aa-0df1-4a3d-9513-6f4b7fcc2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f6217-5139-4aa9-9848-3fd7dfa36b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07f6217-5139-4aa9-9848-3fd7dfa36b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1794278088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87309b4e-78f0-4c9b-a06e-ecd95f62ef1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e950ee2a506c4e1985124c70bcdd8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:35Z,use_quota=True,user_id='a14cca91eb30453894a2e9be975c2104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf13a7-77d8-4e93-af06-5211874c4065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf13a7-77d8-4e93-af06-5211874c4065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02783ff4-10f3-4dcd-bb63-432c53a91a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02783ff4-10f3-4dcd-bb63-432c53a91a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'volume_name': 'volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ee3d8b-52b3-45dd-a549-4d630c9e03cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ee3d8b-52b3-45dd-a549-4d630c9e03cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe82f556-ef36-4e60-886f-dec8e8191d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Volume 87309b4e-78f0-4c9b-a06e-ecd95f62ef1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'volume_size': 1} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Flow 'volume_create_manager' (9a71229e-d28e-41cf-aace-879c3d1c5acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016208df-71c9-4ff5-a9ba-d4c5f4e6c151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016208df-71c9-4ff5-a9ba-d4c5f4e6c151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3691fa36-e902-4cb3-9071-2b7a4f75f048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8586e4cf691e45e08890217e821caa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6ce6996-c571-4f0f-8445-fea696391ce6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:35Z,use_quota=True,user_id='33f806dd1d42430da952ee189c040bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5e4170-e0b5-4693-aa49-59fcdf1f19d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5e4170-e0b5-4693-aa49-59fcdf1f19d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b156d0d-da67-4d7c-afcb-8b9d1bf9018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b156d0d-da67-4d7c-afcb-8b9d1bf9018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3691fa36-e902-4cb3-9071-2b7a4f75f048', 'volume_name': 'volume-3691fa36-e902-4cb3-9071-2b7a4f75f048', 'volume_size': 1, 'snapshot_id': 'b6ce6996-c571-4f0f-8445-fea696391ce6'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8298445-071e-4e98-853d-5d0191cec340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8298445-071e-4e98-853d-5d0191cec340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec0121d-0576-447e-8f1f-d1890a4f7412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:35 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Volume 3691fa36-e902-4cb3-9071-2b7a4f75f048: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3691fa36-e902-4cb3-9071-2b7a4f75f048', 'volume_size': 1, 'snapshot_id': 'b6ce6996-c571-4f0f-8445-fea696391ce6'} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.542s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:35 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Deleted volume successfully. Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-5b58969c-d5eb-4b04-88eb-1a798043b3c8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-35d8abce-ac84-41c1-9c19-ba69d1f4490d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:35 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758" returned: 0 in 0.735s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:35 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758 Apr 13 14:23:35 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:35 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c 1G" returned: 0 in 0.513s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:35 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c Apr 13 14:23:35 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:35 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-2b86ed0e-9a72-42d9-ac46-7536ff7db758" returned: 0 in 0.428s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-2b86ed0e-9a72-42d9-ac46-7536ff7db758" released by "delete_volume" :: held 1.196s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created reservations ['ef729d76-6462-48c1-a61a-af7b0cada5a7', '2cbd6764-5520-4bcf-8203-d1248577a1e7', 'c9cf1b89-9237-42c4-9dfc-07d4e76283fa', 'de22a6fa-8e9c-4505-9149-17634bbabbe6'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:35 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c" returned: 0 in 0.451s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:35 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c is being set with open permissions: ugo+rw Apr 13 14:23:35 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:35 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:35 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:35 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c Apr 13 14:23:35 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:36 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.413s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:36 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Deleted volume successfully. Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ed8f180a-2872-4d82-a099-0e80be55ab20 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-2b86ed0e-9a72-42d9-ac46-7536ff7db758-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:36 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c" returned: 0 in 0.446s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:36 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info Apr 13 14:23:36 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "cinder-quobyte-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f9411-1fb2-45e7-b874-f66ec804e8fa]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:36 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info" returned: 0 in 0.447s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:36 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info is being set with open permissions: ugo+rw Apr 13 14:23:36 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:36 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 Apr 13 14:23:36 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info Apr 13 14:23:36 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:36 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:37 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.info" returned: 0 in 0.404s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1794278088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87309b4e-78f0-4c9b-a06e-ecd95f62ef1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e950ee2a506c4e1985124c70bcdd8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:35Z,use_quota=True,user_id='a14cca91eb30453894a2e9be975c2104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Creating volume 87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:37 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:37 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:37 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f 1073741824 Apr 13 14:23:37 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0" returned: 0 in 0.502s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:37 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-b91cffd7-6f3b-4443-80d4-14f076007ecf tempest-CreateVolumesFromSnapshotTest-1066264253 None] Create snapshot completed successfully Apr 13 14:23:37 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0 Apr 13 14:23:37 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:37 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0" returned: 0 in 0.406s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-quobyte-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0" released by "delete_volume" :: held 0.943s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:37 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f 1073741824" returned: 0 in 0.464s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Created reservations ['741cdcfa-77f6-4393-9263-5be01cc4e20e', 'f1d5e54e-51f4-414f-83b4-2c29ec3756e9', 'd82702d6-6166-4e17-b00a-91bf57146653', '09cf876f-c825-4bd1-8c1d-d44454199fad'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:37 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:37 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:37 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:37 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:37 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:38 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.534s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.009s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-quobyte-b6ce6996-c571-4f0f-8445-fea696391ce6-3691fa36-e902-4cb3-9071-2b7a4f75f048" by "_create_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe82f556-ef36-4e60-886f-dec8e8191d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a802cc-4e63-4355-9661-0f2fc9c8a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.531s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:38 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Deleted volume successfully. Apr 13 14:23:38 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Volume volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f (87309b4e-78f0-4c9b-a06e-ecd95f62ef1f): created successfully Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a802cc-4e63-4355-9661-0f2fc9c8a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (d77e24aa-0df1-4a3d-9513-6f4b7fcc2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-b6ce6996-c571-4f0f-8445-fea696391ce6-3691fa36-e902-4cb3-9071-2b7a4f75f048" acquired by "_create_volume_from_snapshot" :: waited 0.063s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Creating volume 3691fa36-e902-4cb3-9071-2b7a4f75f048 from snapshot b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-quobyte-3691fa36-e902-4cb3-9071-2b7a4f75f048" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:38 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-25a2f0e6-615c-4cd1-a4f2-9545fd508c20 tempest-VolumeDependencyTests-632912676 None] Created volume successfully. Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-3691fa36-e902-4cb3-9071-2b7a4f75f048" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] snapshot: b6ce6996-c571-4f0f-8445-fea696391ce6, volume: 3691fa36-e902-4cb3-9071-2b7a4f75f048, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-1e81cd90-0657-491b-b8b1-7f5decf5ef92 tempest-CreateVolumesFromSourceVolumeTest-460625231 None] Lock "cinder-4f15afdd-f6d5-4deb-8590-b7c510f0b6a0-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896355e-ef11-4264-af9d-fc2cd045124c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (1380a67c-88f8-49b0-9103-b0079f38143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d1d207-57c3-4d36-9513-234be4d5ba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d1d207-57c3-4d36-9513-234be4d5ba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-56432398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0891b4-e55e-4074-8c21-a9d048c365a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:38Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd110f8-d688-43db-871d-ea7a33be7fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd110f8-d688-43db-871d-ea7a33be7fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c029da-292a-41c7-922d-e21b3bccf972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c029da-292a-41c7-922d-e21b3bccf972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0891b4-e55e-4074-8c21-a9d048c365a6', 'volume_name': 'volume-9e0891b4-e55e-4074-8c21-a9d048c365a6', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea03e85-426b-4998-8eab-db1b7cea88e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 Apr 13 14:23:38 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea03e85-426b-4998-8eab-db1b7cea88e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164971a8-aa59-45dd-87cb-0edce662a111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume 9e0891b4-e55e-4074-8c21-a9d048c365a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0891b4-e55e-4074-8c21-a9d048c365a6', 'volume_size': 1} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (d59691ee-ab75-4309-8857-07de9c5e75c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5f7ca5-a803-487c-866b-8b4fffb4c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5f7ca5-a803-487c-866b-8b4fffb4c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501487478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fa3e9e-08c2-4da6-9b66-5adc9fc58bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91c88d1-29e7-45a4-b128-464a7ca895dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91c88d1-29e7-45a4-b128-464a7ca895dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658ab03b-a314-49e0-8934-326f9680fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658ab03b-a314-49e0-8934-326f9680fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fa3e9e-08c2-4da6-9b66-5adc9fc58bac', 'volume_name': 'volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bd282c-71d2-4b71-a4f4-8be0243f9eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bd282c-71d2-4b71-a4f4-8be0243f9eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35359fe7-456f-4e49-aeb4-931ca61a2361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:38 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume 04fa3e9e-08c2-4da6-9b66-5adc9fc58bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac', 'volume_size': 1} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:38 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (f1987fdd-bb80-4c3d-8907-891eaa7dd2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4209e77c-fb92-43c7-b575-6cc4020945c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4209e77c-fb92-43c7-b575-6cc4020945c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770724586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7826e0e7-55d5-49eb-bcba-35060bdd2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6c69cc-af90-4b21-982a-33d7bf6d8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6c69cc-af90-4b21-982a-33d7bf6d8212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30223d56-0f68-4375-852d-9d425bc7ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30223d56-0f68-4375-852d-9d425bc7ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7826e0e7-55d5-49eb-bcba-35060bdd2578', 'volume_name': 'volume-7826e0e7-55d5-49eb-bcba-35060bdd2578', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201e3674-0061-4e38-8370-5fed937aa690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201e3674-0061-4e38-8370-5fed937aa690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3329c6ae-4a52-476f-801d-9c9596ddec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume 7826e0e7-55d5-49eb-bcba-35060bdd2578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7826e0e7-55d5-49eb-bcba-35060bdd2578', 'volume_size': 1} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:39 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6" returned: 0 in 0.706s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfc52b1-da67-4938-99c1-a48ced281ea2]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:39 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:39 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (a59dcea3-e8ec-445b-beff-32437884d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac5bc85-5a1c-4465-b01a-300f925e7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac5bc85-5a1c-4465-b01a-300f925e7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-579135407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2c88cd-30a6-4601-8bdc-5278f84080a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a939da2-783b-4c2b-8470-ffecc0f1b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a939da2-783b-4c2b-8470-ffecc0f1b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd07a501-93ba-4672-8094-af92f14a00df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd07a501-93ba-4672-8094-af92f14a00df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2c88cd-30a6-4601-8bdc-5278f84080a4', 'volume_name': 'volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd33f264-49d5-4f0f-abb2-21d9098010b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd33f264-49d5-4f0f-abb2-21d9098010b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebef92e-75e7-4757-a9d5-2f5b9aaf6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume ca2c88cd-30a6-4601-8bdc-5278f84080a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4', 'volume_size': 1} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (6a548061-0ebb-458b-b09f-96993caa280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100a7665-15c6-40d5-9d3f-97ba31cc2ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100a7665-15c6-40d5-9d3f-97ba31cc2ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788787614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec25bb-8237-4fdb-abbf-792280f053c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21d3e0b-bf20-4722-9cc5-088e11ba33bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21d3e0b-bf20-4722-9cc5-088e11ba33bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a724b0f-8ae3-4309-af03-a34ff7d78774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a724b0f-8ae3-4309-af03-a34ff7d78774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ec25bb-8237-4fdb-abbf-792280f053c7', 'volume_name': 'volume-44ec25bb-8237-4fdb-abbf-792280f053c7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9544277-2c08-499e-a1a4-9ff407f17f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9544277-2c08-499e-a1a4-9ff407f17f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b4da8b-92db-4727-ac05-7265e1fd616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume 44ec25bb-8237-4fdb-abbf-792280f053c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ec25bb-8237-4fdb-abbf-792280f053c7', 'volume_size': 1} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (bb19536d-bff0-4929-b4fc-2bf31c4a66b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fbe213-68e4-47ad-953a-8d148e7e38bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fbe213-68e4-47ad-953a-8d148e7e38bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2141699780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5be41eb-d507-41a7-b5bf-5b895966d934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e950ee2a506c4e1985124c70bcdd8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=87309b4e-78f0-4c9b-a06e-ecd95f62ef1f,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:40Z,use_quota=True,user_id='a14cca91eb30453894a2e9be975c2104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b4b39a-87b0-4b38-b8e6-4cb386f068da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b4b39a-87b0-4b38-b8e6-4cb386f068da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483d88a1-9842-4728-9929-6a8e04afac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483d88a1-9842-4728-9929-6a8e04afac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e5be41eb-d507-41a7-b5bf-5b895966d934', 'volume_name': 'volume-e5be41eb-d507-41a7-b5bf-5b895966d934', 'volume_size': 1, 'source_volid': '87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d5c5fb-48a4-43dd-8aea-6a3d706cd7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d5c5fb-48a4-43dd-8aea-6a3d706cd7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28249ab-1b74-4b03-ab62-61acb9af029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Volume e5be41eb-d507-41a7-b5bf-5b895966d934: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e5be41eb-d507-41a7-b5bf-5b895966d934', 'volume_size': 1, 'source_volid': '87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'source_volstatus': 'available'} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.604s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:39 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 Apr 13 14:23:39 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Flow 'volume_create_manager' (aa7ee42b-cf02-42ac-a19e-332f22a68c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cee4b3-c9d8-450e-be13-f0ff38c41e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cee4b3-c9d8-450e-be13-f0ff38c41e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03daf9d2-958d-47f3-b2ef-03092436c671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b2cd505fc44109b2fc8e83a3b79367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:40Z,use_quota=True,user_id='65254cdacbcd491899b06640dc3061c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e221be1-79c8-46b2-9f90-2a22b3e79029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e221be1-79c8-46b2-9f90-2a22b3e79029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0481f0-41f5-48d3-9ad0-d9b8009eb87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0481f0-41f5-48d3-9ad0-d9b8009eb87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03daf9d2-958d-47f3-b2ef-03092436c671', 'volume_name': 'volume-03daf9d2-958d-47f3-b2ef-03092436c671', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465ae0a8-10ca-4d64-9762-f9e76fceb081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465ae0a8-10ca-4d64-9762-f9e76fceb081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae854ba5-761f-458e-a831-b26d46c1d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:39 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Volume 03daf9d2-958d-47f3-b2ef-03092436c671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03daf9d2-958d-47f3-b2ef-03092436c671', 'volume_size': 1} Apr 13 14:23:39 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:41 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048" returned: 0 in 2.034s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:41 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc5da2-bb14-4692-9ef0-bc3333fc6786]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:41 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:41 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:41 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:42 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.592s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:23:42 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Converted 1024.00 MB image at 503.22 MB/s Apr 13 14:23:42 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 is being set with open permissions: ugo+rw Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:42 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 Apr 13 14:23:42 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:42 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048" returned: 0 in 0.426s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-3691fa36-e902-4cb3-9071-2b7a4f75f048" released by "_copy_volume_from_snapshot" :: held 4.446s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-b6ce6996-c571-4f0f-8445-fea696391ce6-3691fa36-e902-4cb3-9071-2b7a4f75f048" released by "_create_volume_from_snapshot" :: held 4.472s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.537s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.308s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-56432398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0891b4-e55e-4074-8c21-a9d048c365a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:38Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating volume 9e0891b4-e55e-4074-8c21-a9d048c365a6 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:42 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:42 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 1073741824 Apr 13 14:23:42 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec0121d-0576-447e-8f1f-d1890a4f7412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3691fa36-e902-4cb3-9071-2b7a4f75f048', 'volume_size': 1, 'snapshot_id': 'b6ce6996-c571-4f0f-8445-fea696391ce6'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29458c5e-316d-4fd6-ad0d-eee5e4126cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:42 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Volume volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 (3691fa36-e902-4cb3-9071-2b7a4f75f048): created successfully Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29458c5e-316d-4fd6-ad0d-eee5e4126cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:42 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Flow 'volume_create_manager' (9a71229e-d28e-41cf-aace-879c3d1c5acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:42 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-12396994-732a-4ac9-b9a2-b3d0a4cb9edf tempest-SnapshotDependencyTests-2128198150 None] Created volume successfully. Apr 13 14:23:43 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 1073741824" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:43 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 Apr 13 14:23:43 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:43 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6" returned: 0 in 0.399s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.971s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501487478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fa3e9e-08c2-4da6-9b66-5adc9fc58bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating volume 04fa3e9e-08c2-4da6-9b66-5adc9fc58bac {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:43 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164971a8-aa59-45dd-87cb-0edce662a111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0891b4-e55e-4074-8c21-a9d048c365a6', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:43 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac 1073741824 Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e049d420-514d-4d13-a532-9a2ed35274d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:43 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:43 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 (9e0891b4-e55e-4074-8c21-a9d048c365a6): created successfully Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e049d420-514d-4d13-a532-9a2ed35274d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (1380a67c-88f8-49b0-9103-b0079f38143a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:43 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-5f1771d8-fef6-477d-a39a-ba4a72e10b87 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created volume successfully. Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-b6ce6996-c571-4f0f-8445-fea696391ce6-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-b6ce6996-c571-4f0f-8445-fea696391ce6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-quobyte-932f1cb5-7748-4d48-8c61-01012ed5a9cd" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-932f1cb5-7748-4d48-8c61-01012ed5a9cd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-quobyte-b6ce6996-c571-4f0f-8445-fea696391ce6" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-b6ce6996-c571-4f0f-8445-fea696391ce6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:43 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Deleting offline snapshot b6ce6996-c571-4f0f-8445-fea696391ce6 of volume 932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] snapshot_file for this snap is: volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ededd282-0e0b-43a8-888a-73a2e72956d7]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:44 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 Apr 13 14:23:44 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:44 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac 1073741824" returned: 0 in 0.520s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:44 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac Apr 13 14:23:44 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:44 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6" returned: 0 in 0.477s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747644f-c917-4c1d-bbbe-84f49a3fa363]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:44 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:44 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:44 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac" returned: 0 in 0.414s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.709s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-770724586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7826e0e7-55d5-49eb-bcba-35060bdd2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating volume 7826e0e7-55d5-49eb-bcba-35060bdd2578 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:44 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35359fe7-456f-4e49-aeb4-931ca61a2361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:44 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 1073741824 Apr 13 14:23:44 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acbf7fe-aa05-4551-ad99-8167d371e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:44 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac (04fa3e9e-08c2-4da6-9b66-5adc9fc58bac): created successfully Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acbf7fe-aa05-4551-ad99-8167d371e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:44 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (d59691ee-ab75-4309-8857-07de9c5e75c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:44 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-768b0cb2-09f3-4052-bef8-cfd3850b6cfa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created volume successfully. Apr 13 14:23:45 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:45 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 Apr 13 14:23:45 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:45 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 1073741824" returned: 0 in 0.548s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:45 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 Apr 13 14:23:45 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:45 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:45 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6 Apr 13 14:23:45 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:45 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578" returned: 0 in 0.412s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.373s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-579135407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2c88cd-30a6-4601-8bdc-5278f84080a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating volume ca2c88cd-30a6-4601-8bdc-5278f84080a4 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:45 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3329c6ae-4a52-476f-801d-9c9596ddec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7826e0e7-55d5-49eb-bcba-35060bdd2578', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:45 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 1073741824 Apr 13 14:23:45 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb122934-c06c-416b-a35b-c377ea7c62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:45 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 (7826e0e7-55d5-49eb-bcba-35060bdd2578): created successfully Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb122934-c06c-416b-a35b-c377ea7c62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:45 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (f1987fdd-bb80-4c3d-8907-891eaa7dd2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:45 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-236908df-0331-4242-8b69-9068dd8fd0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created volume successfully. Apr 13 14:23:46 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd.b6ce6996-c571-4f0f-8445-fea696391ce6" returned: 0 in 0.462s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-b6ce6996-c571-4f0f-8445-fea696391ce6" released by "_delete_snapshot" :: held 2.053s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-932f1cb5-7748-4d48-8c61-01012ed5a9cd" released by "delete_snapshot" :: held 2.068s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Created reservations ['c49db40a-6b38-46f3-b15d-e4372a8c8466', 'aa4b808f-dcea-43bc-a161-2e55341fcbd6', '0a7b9e25-3051-49ad-b376-757294a72f61', '1a09173f-842d-4fa0-b64e-3057eab741ef'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Delete snapshot completed successfully. Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-531cdc11-c378-48fb-8911-b613db512404 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-b6ce6996-c571-4f0f-8445-fea696391ce6-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:46 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 1073741824" returned: 0 in 0.578s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:46 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 Apr 13 14:23:46 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:46 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4" returned: 0 in 0.431s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.236s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788787614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec25bb-8237-4fdb-abbf-792280f053c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2922d58d1d1e412c8e6001af741063e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:39Z,use_quota=True,user_id='c406e5a2ce86431ead64d1bee3157237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Creating volume 44ec25bb-8237-4fdb-abbf-792280f053c7 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:46 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebef92e-75e7-4757-a9d5-2f5b9aaf6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:46 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 1073741824 Apr 13 14:23:46 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d82000f-8727-498d-8dd1-60172e1a1f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:46 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 (ca2c88cd-30a6-4601-8bdc-5278f84080a4): created successfully Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d82000f-8727-498d-8dd1-60172e1a1f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:46 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (a59dcea3-e8ec-445b-beff-32437884d600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:46 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-2da42d69-784d-4b12-af11-557f94800ba7 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created volume successfully. Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-932f1cb5-7748-4d48-8c61-01012ed5a9cd-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-932f1cb5-7748-4d48-8c61-01012ed5a9cd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-quobyte-932f1cb5-7748-4d48-8c61-01012ed5a9cd" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-932f1cb5-7748-4d48-8c61-01012ed5a9cd" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc1a41-c4a4-4069-8b05-471b40184d90]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:47 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:47 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:47 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 1073741824" returned: 0 in 0.544s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:47 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 Apr 13 14:23:47 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:47 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.529s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:47 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd Apr 13 14:23:47 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:47 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7" returned: 0 in 0.388s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.929s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:47 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Cloning volume 87309b4e-78f0-4c9b-a06e-ecd95f62ef1f to volume e5be41eb-d507-41a7-b5bf-5b895966d934 Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b4da8b-92db-4727-ac05-7265e1fd616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ec25bb-8237-4fdb-abbf-792280f053c7', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b32d7af-db72-4457-9ffb-f4ebd3d7cab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:47 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Volume volume-44ec25bb-8237-4fdb-abbf-792280f053c7 (44ec25bb-8237-4fdb-abbf-792280f053c7): created successfully Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b32d7af-db72-4457-9ffb-f4ebd3d7cab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Flow 'volume_create_manager' (6a548061-0ebb-458b-b09f-96993caa280b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Creating offline snapshot 415c6820-1498-4404-83d2-af016fbe15ad of volume 87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:23:47 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-249d8ed3-b548-4042-8ea3-c6c91032d492 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created volume successfully. Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb2e05-72cf-4de0-abfa-eb55adffc62f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:47 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:47 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:47 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:48 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-932f1cb5-7748-4d48-8c61-01012ed5a9cd" returned: 0 in 0.428s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-932f1cb5-7748-4d48-8c61-01012ed5a9cd" released by "delete_volume" :: held 0.992s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Created reservations ['ecfeede8-865e-45a4-b5c9-7b1fc223b8f4', '24bd71b2-8a14-4abd-a6c4-17098e2da9e9', '3ad5bf5f-e195-4658-a359-e19de58b570d', 'a144bbca-3115-4b49-8a38-f7b4917a2993'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:48 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:48 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:48 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:48 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad 1G Apr 13 14:23:48 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-44ec25bb-8237-4fdb-abbf-792280f053c7-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-44ec25bb-8237-4fdb-abbf-792280f053c7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-44ec25bb-8237-4fdb-abbf-792280f053c7" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-44ec25bb-8237-4fdb-abbf-792280f053c7" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6150c880-11a1-4926-b500-21d7bbe2bd0b]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:48 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 Apr 13 14:23:48 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:48 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:48 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Deleted volume successfully. Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-ebe94636-d456-4509-9c5c-c01e0e2729a6 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-932f1cb5-7748-4d48-8c61-01012ed5a9cd-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:48 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad 1G" returned: 0 in 0.558s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:48 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:48 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad Apr 13 14:23:48 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:48 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7" returned: 0 in 0.484s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7 Apr 13 14:23:49 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-3691fa36-e902-4cb3-9071-2b7a4f75f048-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-3691fa36-e902-4cb3-9071-2b7a4f75f048-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "cinder-quobyte-3691fa36-e902-4cb3-9071-2b7a4f75f048" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:49 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-3691fa36-e902-4cb3-9071-2b7a4f75f048" acquired by "delete_volume" :: waited 0.021s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad" returned: 0 in 0.490s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:49 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad is being set with open permissions: ugo+rw Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2514058-1a68-4b31-8bb9-8586cdd4270d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad Apr 13 14:23:49 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-44ec25bb-8237-4fdb-abbf-792280f053c7" returned: 0 in 0.440s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-44ec25bb-8237-4fdb-abbf-792280f053c7" released by "delete_volume" :: held 0.945s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:49 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 Apr 13 14:23:49 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['98deacaa-7e5f-42ec-8db5-928d58a553a8', 'd404c539-a1b7-4ea9-856b-0075749d1458', 'b8bb4858-1ec5-452c-acce-0564f06b04ed', '112ce33c-ed71-4e08-8cc0-fac05228cc86'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:49 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-ca2c88cd-30a6-4601-8bdc-5278f84080a4-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-ca2c88cd-30a6-4601-8bdc-5278f84080a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-ca2c88cd-30a6-4601-8bdc-5278f84080a4" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-ca2c88cd-30a6-4601-8bdc-5278f84080a4" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50f7232-fdb8-430c-89de-759c3d1fd273]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 Apr 13 14:23:49 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:49 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048" returned: 0 in 0.495s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad" returned: 0 in 0.516s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:49 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048 Apr 13 14:23:49 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:49 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info Apr 13 14:23:49 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:49 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.480s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:49 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleted volume successfully. Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-41529af8-fbe3-421c-8721-88199ad6a7e1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-44ec25bb-8237-4fdb-abbf-792280f053c7-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:50 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4" returned: 0 in 0.539s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:50 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4 Apr 13 14:23:50 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:50 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-3691fa36-e902-4cb3-9071-2b7a4f75f048" returned: 0 in 0.409s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-quobyte-3691fa36-e902-4cb3-9071-2b7a4f75f048" released by "delete_volume" :: held 0.932s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Created reservations ['623fcbb8-0574-4e75-bbbf-91a4c336acf0', '3dc9ef1e-12eb-4e01-a517-e33fac448a72', '0a5aa3d2-46be-4988-9e87-6ce3bb05019b', 'e3bb422b-5e5f-4523-b8f4-c07f9038765a'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:50 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info" returned: 0 in 0.469s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:50 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info is being set with open permissions: ugo+rw Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:50 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:50 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:50 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info Apr 13 14:23:50 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:50 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-ca2c88cd-30a6-4601-8bdc-5278f84080a4" returned: 0 in 0.426s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-ca2c88cd-30a6-4601-8bdc-5278f84080a4" released by "delete_volume" :: held 0.987s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['fa683401-7edf-4237-8c08-fc653e8db27a', '4c4d928d-6a4b-413c-a48d-dd8c2fb94625', '881f4aeb-1a98-4604-9783-3033ed01626d', 'db9bd872-2973-43d9-960a-69e1b5829859'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:50 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-7826e0e7-55d5-49eb-bcba-35060bdd2578-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:50 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-7826e0e7-55d5-49eb-bcba-35060bdd2578-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-7826e0e7-55d5-49eb-bcba-35060bdd2578" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-7826e0e7-55d5-49eb-bcba-35060bdd2578" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0111234-2e12-4234-aa78-57f4627a8f80]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:50 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.info" returned: 0 in 0.524s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-e5be41eb-d507-41a7-b5bf-5b895966d934" by "_copy_volume_from_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-e5be41eb-d507-41a7-b5bf-5b895966d934" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] snapshot: 415c6820-1498-4404-83d2-af016fbe15ad, volume: e5be41eb-d507-41a7-b5bf-5b895966d934, {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:50 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.567s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1d91ab-7cfd-4bad-aa79-26c7369f6aa6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:50 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Deleted volume successfully. Apr 13 14:23:50 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 Apr 13 14:23:50 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:50 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-42db8fff-ba53-4e8a-b8c1-c120ae5c97f8 tempest-SnapshotDependencyTests-2128198150 None] Lock "cinder-3691fa36-e902-4cb3-9071-2b7a4f75f048-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:51 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad Apr 13 14:23:51 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:51 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.573s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:51 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleted volume successfully. Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-857fe91d-1128-4af1-9c8d-5496f9549d7d tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-ca2c88cd-30a6-4601-8bdc-5278f84080a4-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:51 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad" returned: 0 in 0.529s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Creating direct copy from snapshot {{(pid=82621) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa16021b-0ae1-41f6-8f88-77777dfbc669]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:51 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578" returned: 0 in 0.652s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:51 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578 Apr 13 14:23:51 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:51 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:51 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:51 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.526s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG cinder.utils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Path /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 not found in is_blk_device check {{(pid=82621) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 14:23:51 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:52 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-7826e0e7-55d5-49eb-bcba-35060bdd2578" returned: 0 in 0.501s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-7826e0e7-55d5-49eb-bcba-35060bdd2578" released by "delete_volume" :: held 1.181s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:52 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 Apr 13 14:23:52 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['91db980a-0754-41cb-8f6e-920c1c6d726c', '35c61843-fd40-434a-b6d0-c562b1ae3aa2', '4b87fd67-2caa-499a-a3ad-8f845f038dd1', 'ffdc050a-3308-4a80-915f-d9381783ca41'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:52 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:52 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:52 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.579s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:52 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleted volume successfully. Apr 13 14:23:52 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-194e05a2-b419-48aa-93f9-6ff1cc8b9faa tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-7826e0e7-55d5-49eb-bcba-35060bdd2578-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:53 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac" acquired by "delete_volume" :: waited 0.035s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:53 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c4b1e1-030e-4372-b742-433f09f48136]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:53 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:53 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac Apr 13 14:23:53 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:54 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac" returned: 0 in 1.032s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:54 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac Apr 13 14:23:54 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:54 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934" returned: 0 in 2.376s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f073528-5d6d-4678-a8b8-ac23f1736982]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:54 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:54 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:54 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac" returned: 0 in 0.403s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac" released by "delete_volume" :: held 1.511s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['e214bfae-ed1e-4f2b-bf79-27a454bf9995', 'f3db80ce-8fb9-481d-b3a4-89c1dbb25261', '5af876a5-2740-4bc1-a5a9-e58e3468a0c4', '244bf74e-e442-43c2-a17d-4da4c3d3f6fc'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:54 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:54 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:54 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:55 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.655s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.image.image_utils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Image conversion details: src /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 {{(pid=82621) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 14:23:55 devstack cinder-volume[82621]: INFO cinder.image.image_utils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Converted 1024.00 MB image at 430.59 MB/s Apr 13 14:23:55 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 is being set with open permissions: ugo+rw Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:55 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 Apr 13 14:23:55 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:55 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.472s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:55 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleted volume successfully. Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-f4ada32b-e161-4954-9449-dc9d611e3d05 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-04fa3e9e-08c2-4da6-9b66-5adc9fc58bac-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-9e0891b4-e55e-4074-8c21-a9d048c365a6-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-9e0891b4-e55e-4074-8c21-a9d048c365a6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-9e0891b4-e55e-4074-8c21-a9d048c365a6" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-9e0891b4-e55e-4074-8c21-a9d048c365a6" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89babc0-d2c2-4ade-92de-4083fb0d3dda]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:55 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 Apr 13 14:23:55 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:55 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934" returned: 0 in 0.518s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-e5be41eb-d507-41a7-b5bf-5b895966d934" released by "_copy_volume_from_snapshot" :: held 4.651s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-415c6820-1498-4404-83d2-af016fbe15ad" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-415c6820-1498-4404-83d2-af016fbe15ad" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Deleting offline snapshot 415c6820-1498-4404-83d2-af016fbe15ad of volume 87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] snapshot_file for this snap is: volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd967104-3825-4263-a03b-49d04fba4ecc]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:55 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad Apr 13 14:23:55 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:55 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:55 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:55 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6 Apr 13 14:23:56 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:56 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad" returned: 0 in 0.528s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69d96ef-aae7-4e76-ae6a-6b42f8c1e3f7]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:56 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:56 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:56 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-9e0891b4-e55e-4074-8c21-a9d048c365a6" returned: 0 in 0.501s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-9e0891b4-e55e-4074-8c21-a9d048c365a6" released by "delete_volume" :: held 1.043s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['3db291dd-edbe-456c-aee4-51d073f88456', 'a32014c1-9152-4b6a-9b1e-33497347e54c', '1a05d05b-af6e-4a97-a544-e63e3e78d81d', '2b90f962-bcfd-4e2a-87e8-06d92ec20081'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:56 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:23:56 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:56 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.485s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:56 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:56 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad Apr 13 14:23:56 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:57 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.446s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:23:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleted volume successfully. Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-3eb48db2-134f-49c5-8539-05f6adbab0ed tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-9e0891b4-e55e-4074-8c21-a9d048c365a6-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:57 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad" returned: 0 in 0.531s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:57 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad Apr 13 14:23:57 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-d89d769b-f46d-44a2-846c-f754b2edad5c-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-d89d769b-f46d-44a2-846c-f754b2edad5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-d89d769b-f46d-44a2-846c-f754b2edad5c" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-d89d769b-f46d-44a2-846c-f754b2edad5c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleting offline snapshot d89d769b-f46d-44a2-846c-f754b2edad5c of volume 8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] snapshot_file for this snap is: volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[914199bf-b5c9-43b1-8690-ac6ab701f5d6]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:57 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f.415c6820-1498-4404-83d2-af016fbe15ad" returned: 0 in 0.485s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-415c6820-1498-4404-83d2-af016fbe15ad" released by "_delete_snapshot" :: held 2.096s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.944s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.808s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03daf9d2-958d-47f3-b2ef-03092436c671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b2cd505fc44109b2fc8e83a3b79367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:40Z,use_quota=True,user_id='65254cdacbcd491899b06640dc3061c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Creating volume 03daf9d2-958d-47f3-b2ef-03092436c671 {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:57 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:57 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c Apr 13 14:23:57 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:57 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 1073741824 Apr 13 14:23:57 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28249ab-1b74-4b03-ab62-61acb9af029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5be41eb-d507-41a7-b5bf-5b895966d934', 'volume_size': 1, 'source_volid': '87309b4e-78f0-4c9b-a06e-ecd95f62ef1f', 'source_volstatus': 'available'}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21e32c1-80bd-41b9-b4ee-4af8beec2520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:57 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Volume volume-e5be41eb-d507-41a7-b5bf-5b895966d934 (e5be41eb-d507-41a7-b5bf-5b895966d934): created successfully Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21e32c1-80bd-41b9-b4ee-4af8beec2520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:57 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Flow 'volume_create_manager' (bb19536d-bff0-4929-b4fc-2bf31c4a66b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:57 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-c0398676-e443-4563-a3ff-337c0d4fa3ca tempest-VolumeDependencyTests-632912676 None] Created volume successfully. Apr 13 14:23:58 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c" returned: 0 in 0.581s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd10c6ac-8538-4fce-afa4-b34c552dde35]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:58 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 1073741824" returned: 0 in 0.559s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:58 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 Apr 13 14:23:58 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:58 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 Apr 13 14:23:58 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:58 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671" returned: 0 in 0.388s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae854ba5-761f-458e-a831-b26d46c1d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03daf9d2-958d-47f3-b2ef-03092436c671', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e605d7b7-0f10-4ab5-af45-2895a176d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:58 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Volume volume-03daf9d2-958d-47f3-b2ef-03092436c671 (03daf9d2-958d-47f3-b2ef-03092436c671): created successfully Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e605d7b7-0f10-4ab5-af45-2895a176d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Flow 'volume_create_manager' (aa7ee42b-cf02-42ac-a19e-332f22a68c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:58 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" returned: 0 in 0.485s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:58 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-884021b9-048d-4e05-b147-2cc67ce4412e tempest-CinderUnicodeTest-1041780885 None] Created volume successfully. Apr 13 14:23:58 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c Apr 13 14:23:58 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba5b89-aa57-41a7-94ac-9af90effd80f]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:23:58 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:59 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:59 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:59 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c" returned: 0 in 0.473s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:59 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c Apr 13 14:23:59 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:59 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82621) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Flow 'volume_create_manager' (ea519ab4-4c8d-420e-9e5f-88765aaced45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5db850-adce-45ec-9443-1d97511adb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.541s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:59 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5db850-adce-45ec-9443-1d97511adb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1826158156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179997ec-3992-45a9-9ef5-b242289f05bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b2cd505fc44109b2fc8e83a3b79367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:59Z,use_quota=True,user_id='65254cdacbcd491899b06640dc3061c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:59 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87142c13-650f-4f09-81fe-41e02f238aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87142c13-650f-4f09-81fe-41e02f238aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ec26cf-e110-4b25-b74b-699184ef43ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ec26cf-e110-4b25-b74b-699184ef43ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179997ec-3992-45a9-9ef5-b242289f05bc', 'volume_name': 'volume-179997ec-3992-45a9-9ef5-b242289f05bc', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2192176-5dc5-4799-adda-13269aa5f8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2192176-5dc5-4799-adda-13269aa5f8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8313a680-0996-4e82-b87f-10d5db5bc8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:23:59 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Volume 179997ec-3992-45a9-9ef5-b242289f05bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179997ec-3992-45a9-9ef5-b242289f05bc', 'volume_size': 1} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T12:23:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1826158156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179997ec-3992-45a9-9ef5-b242289f05bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b2cd505fc44109b2fc8e83a3b79367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T12:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T12:23:59Z,use_quota=True,user_id='65254cdacbcd491899b06640dc3061c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24fb83df-282b-49c8-b0e9-25ea8fbd8fff),volume_type_id=24fb83df-282b-49c8-b0e9-25ea8fbd8fff)}" {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Creating volume 179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Selected osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 as target Quobyte volume. {{(pid=82621) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 14:23:59 devstack cinder-volume[82621]: INFO cinder.volume.drivers.remotefs [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] casted to osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1 Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc 1073741824 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:23:59 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc 1073741824 Apr 13 14:23:59 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:23:59 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5.d89d769b-f46d-44a2-846c-f754b2edad5c" returned: 0 in 0.446s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-d89d769b-f46d-44a2-846c-f754b2edad5c" released by "_delete_snapshot" :: held 2.044s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" released by "delete_snapshot" :: held 2.056s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['81ed53db-a123-4971-8b84-a25362dbcabf', '70217631-29ac-46ef-8480-851bf2559f12', 'd930696d-de0b-42ed-b95a-28a107b987d6', '23ea0bcb-af3a-486a-af3a-df6e44788afb'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:23:59 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Delete snapshot completed successfully. Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-02f449e8-4b86-48f4-8156-b3e43509a25c tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-d89d769b-f46d-44a2-846c-f754b2edad5c-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:59 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" returned: 0 in 0.435s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f" released by "delete_volume" :: held 1.004s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:23:59 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Created reservations ['d54c46df-655b-46e0-8c3b-5dd7f988ea54', 'cc38d4fa-b8c7-4e9d-b6a9-f7463c025cf0', '2ef54a2d-39d2-4b8b-b2e6-3b19c9aeb0b1', '2282622e-33ae-4691-a088-fba20d54ecb9'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:00 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:24:00 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:00 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc 1073741824" returned: 0 in 0.500s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:00 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc Apr 13 14:24:00 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:00 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:24:00 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Deleted volume successfully. Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-0ff39f7b-5652-4637-b06b-97fa84631cc4 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-87309b4e-78f0-4c9b-a06e-ecd95f62ef1f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:00 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc" returned: 0 in 0.407s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'} {{(pid=82621) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8313a680-0996-4e82-b87f-10d5db5bc8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179997ec-3992-45a9-9ef5-b242289f05bc', 'volume_size': 1}' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a19093-760b-404f-b7ea-c851ae39d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 14:24:00 devstack cinder-volume[82621]: INFO cinder.volume.flows.manager.create_volume [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Volume volume-179997ec-3992-45a9-9ef5-b242289f05bc (179997ec-3992-45a9-9ef5-b242289f05bc): created successfully Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a19093-760b-404f-b7ea-c851ae39d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82621) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Flow 'volume_create_manager' (ea519ab4-4c8d-420e-9e5f-88765aaced45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82621) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 14:24:00 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-1b0f660d-b6ba-4dc9-90c4-1b419df75958 tempest-CinderUnicodeTest-1041780885 None] Created volume successfully. Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-8dcc2e2a-08e7-4802-862b-d9c40393c5d5-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-8dcc2e2a-08e7-4802-862b-d9c40393c5d5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "cinder-quobyte-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cc3f22-68f0-4f3d-abab-eaf098c38a8d]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:00 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:00 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 Apr 13 14:24:00 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-e5be41eb-d507-41a7-b5bf-5b895966d934-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-e5be41eb-d507-41a7-b5bf-5b895966d934-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-e5be41eb-d507-41a7-b5bf-5b895966d934" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-e5be41eb-d507-41a7-b5bf-5b895966d934" acquired by "delete_volume" :: waited 0.007s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d1595a-a584-4b9a-b60e-a6c7641fc108]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:01 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 Apr 13 14:24:01 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:01 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" returned: 0 in 0.515s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:01 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5 Apr 13 14:24:01 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:01 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934" returned: 0 in 0.480s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:01 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934 Apr 13 14:24:01 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:01 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" returned: 0 in 0.440s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Creating offline snapshot 31c61d0b-84ed-48bf-927b-08c0578b5404 of volume 179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-quobyte-8dcc2e2a-08e7-4802-862b-d9c40393c5d5" released by "delete_volume" :: held 1.000s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf2bee-6c5f-474c-9ca3-a5104891e6da]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Created reservations ['a74e5eec-e448-4157-ba0c-181d9a3fb46d', '76a1eb19-1285-4540-99c7-0675e65bd5d1', '4336153b-fc09-4a86-90e8-1d66d85b1d78', 'fa89eb3e-bb63-467f-bc53-1173e68fc8d1'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:01 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc Apr 13 14:24:01 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:01 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:01 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:24:01 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:02 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-e5be41eb-d507-41a7-b5bf-5b895966d934" returned: 0 in 0.454s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-e5be41eb-d507-41a7-b5bf-5b895966d934" released by "delete_volume" :: held 0.955s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Created reservations ['af152274-9e52-4ba4-9957-6263866c9bf5', 'd44a2c4b-3863-45f9-b3db-feeb397c300a', 'f0fc0495-df66-45ca-81c0-e2b275924297', 'f7a32b55-af9d-4b9d-90d4-f99614e7984b'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:02 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:24:02 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-cc8a522c-3b6f-4bd0-b383-88839b091863-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-cc8a522c-3b6f-4bd0-b383-88839b091863-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "cinder-quobyte-cc8a522c-3b6f-4bd0-b383-88839b091863" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-cc8a522c-3b6f-4bd0-b383-88839b091863" acquired by "delete_volume" :: waited 0.016s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0a49d5-3a6f-4743-896c-38e9eefb3d8c]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:02 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.466s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:24:02 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc" returned: 0 in 0.583s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 1G {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Deleted volume successfully. Apr 13 14:24:02 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 1G Apr 13 14:24:02 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-16d14820-9498-4c5a-b725-7feac1b1b6f1 tempest-CreateVolumesFromSnapshotTest-1066264253 None] Lock "cinder-8dcc2e2a-08e7-4802-862b-d9c40393c5d5-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:02 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 Apr 13 14:24:02 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:02 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.455s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:24:02 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Deleted volume successfully. Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-48512273-ced3-40b3-a5ac-af3090518c54 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-e5be41eb-d507-41a7-b5bf-5b895966d934-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:02 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 1G" returned: 0 in 0.492s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179997ec-3992-45a9-9ef5-b242289f05bc -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:02 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863" returned: 0 in 0.536s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:02 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:02 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179997ec-3992-45a9-9ef5-b242289f05bc -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 Apr 13 14:24:02 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:02 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863 Apr 13 14:24:02 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:03 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:03 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179997ec-3992-45a9-9ef5-b242289f05bc -F qcow2 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404" returned: 0 in 0.447s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:03 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 is being set with open permissions: ugo+rw Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-cc8a522c-3b6f-4bd0-b383-88839b091863" returned: 0 in 0.452s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-quobyte-cc8a522c-3b6f-4bd0-b383-88839b091863" released by "delete_volume" :: held 1.017s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:03 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 Apr 13 14:24:03 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Created reservations ['d065e8be-72d8-4d35-aee3-0675b18e9653', '26b2cc9b-43d9-4035-97cf-6e667fc7fd1e', 'a9309795-0e22-4eb5-848b-efd1ea5a4b49', '4d49b0ca-7bee-403c-802b-9e14c1e599f8'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:03 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:24:03 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:03 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404" returned: 0 in 0.505s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:03 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info Apr 13 14:24:03 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:03 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.507s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:24:03 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Deleted volume successfully. Apr 13 14:24:03 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-93c19a28-9251-4667-bb49-2bc73a80f6a8 tempest-VolumeDependencyTests-632912676 None] Lock "cinder-cc8a522c-3b6f-4bd0-b383-88839b091863-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:04 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info" returned: 0 in 0.415s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:04 devstack cinder-volume[82621]: WARNING cinder.volume.drivers.remotefs [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info is being set with open permissions: ugo+rw Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:04 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info Apr 13 14:24:04 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:04 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.info" returned: 0 in 0.463s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.976s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:04 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6a1cf82c-ab50-48ae-8eef-2b4c48127812 tempest-CinderUnicodeTest-1041780885 None] Create snapshot completed successfully Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-31c61d0b-84ed-48bf-927b-08c0578b5404-delete_snapshot" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-31c61d0b-84ed-48bf-927b-08c0578b5404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-quobyte-179997ec-3992-45a9-9ef5-b242289f05bc" by "delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-179997ec-3992-45a9-9ef5-b242289f05bc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-quobyte-31c61d0b-84ed-48bf-927b-08c0578b5404" by "_delete_snapshot" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-31c61d0b-84ed-48bf-927b-08c0578b5404" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Deleting offline snapshot 31c61d0b-84ed-48bf-927b-08c0578b5404 of volume 179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] snapshot_file for this snap is: volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 {{(pid=82621) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[95087c15-bf0c-42dc-9576-8e8ffe8483b0]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:04 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:05 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 Apr 13 14:24:05 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:05 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404" returned: 0 in 0.509s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:05 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.remotefs [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179997ec-3992-45a9-9ef5-b242289f05bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82621) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 14:24:05 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec8fb28-b609-418e-a429-0ff0c8b4bb50]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:05 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc Apr 13 14:24:05 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:05 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc" returned: 0 in 0.453s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:05 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:05 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 Apr 13 14:24:05 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:06 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404" returned: 0 in 0.444s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:06 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404 Apr 13 14:24:06 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:06 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc.31c61d0b-84ed-48bf-927b-08c0578b5404" returned: 0 in 0.394s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:SELECT=206,cinder:UPDATE=252,cinder:DELETE=20,cinder:INSERT=63 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG dbcounter [-] [82621] Writing DB stats cinder:UPDATE=310,cinder:SELECT=195,cinder:INSERT=70,cinder:DELETE=32 {{(pid=82621) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-31c61d0b-84ed-48bf-927b-08c0578b5404" released by "_delete_snapshot" :: held 1.857s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-179997ec-3992-45a9-9ef5-b242289f05bc" released by "delete_snapshot" :: held 1.872s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Created reservations ['c2dc4532-b060-404e-bbca-5b6b415941c0', '91e032a3-0a7d-407d-877a-ea5cb698bdcb', 'c2730047-68f2-4348-8c59-40e82e3d8ba8', '8c97fb44-4a55-47c6-9da0-b38df90dd0b5'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:06 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Delete snapshot completed successfully. Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-6090800e-19b5-46f7-aee0-6d5510c6dcbb tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-31c61d0b-84ed-48bf-927b-08c0578b5404-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:06 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-179997ec-3992-45a9-9ef5-b242289f05bc-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-179997ec-3992-45a9-9ef5-b242289f05bc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-quobyte-179997ec-3992-45a9-9ef5-b242289f05bc" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-179997ec-3992-45a9-9ef5-b242289f05bc" acquired by "delete_volume" :: waited 0.011s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d5c08-26f2-4013-bb54-9969acc60050]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:07 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc Apr 13 14:24:07 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:07 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc" returned: 0 in 0.486s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:07 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc Apr 13 14:24:07 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:07 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-179997ec-3992-45a9-9ef5-b242289f05bc" returned: 0 in 0.431s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:07 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-179997ec-3992-45a9-9ef5-b242289f05bc" released by "delete_volume" :: held 0.945s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Created reservations ['1a124aa0-5398-4ca4-b173-9a7399fe95ee', '88ba41b4-ed8a-445a-85ad-b5a1b99832e5', '363ad464-d457-492e-b531-872a21e630e3', 'd7f8fdae-71a4-4538-a4de-1dafd04c0689'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:08 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:24:08 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-03daf9d2-958d-47f3-b2ef-03092436c671-delete_volume" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-03daf9d2-958d-47f3-b2ef-03092436c671-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "cinder-quobyte-03daf9d2-958d-47f3-b2ef-03092436c671" by "delete_volume" {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-03daf9d2-958d-47f3-b2ef-03092436c671" acquired by "delete_volume" :: waited 0.008s {{(pid=82621) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f977009-d52b-493e-94b2-35f8f397f9f3]: (4, 'qcow2') {{(pid=83442) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:08 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 Apr 13 14:24:08 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:08 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.434s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:24:08 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Deleted volume successfully. Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-7dafdf9d-37b8-442f-bccb-fcad0e57b77e tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-179997ec-3992-45a9-9ef5-b242289f05bc-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:08 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671" returned: 0 in 0.459s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:08 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:08 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671 Apr 13 14:24:08 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:09 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214/volume-03daf9d2-958d-47f3-b2ef-03092436c671" returned: 0 in 0.410s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-quobyte-03daf9d2-958d-47f3-b2ef-03092436c671" released by "delete_volume" :: held 0.888s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG cinder.quota [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Created reservations ['eab98fd2-fb75-47df-b6ea-7d6fc46e31f3', '7b262a08-04e2-4061-a69e-ff34015b94cb', 'a9f4863f-819a-4659-8167-dd6e5f2ceceb', '614ea7f4-3c74-4d4b-adb0-bd4b548a12bc'] {{(pid=82621) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1': None} {{(pid=82621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10c38e58-8cc0-4855-834e-3df68d71b3a1'] {{(pid=82621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.lockutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 14:24:09 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214 Apr 13 14:24:09 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 14:24:09 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG oslo_concurrency.processutils [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/437326e32ff97ebb32f158720ad53214" returned: 0 in 0.424s {{(pid=82621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG cinder.manager [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Notifying Schedulers of capabilities ... {{(pid=82621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 14:24:09 devstack cinder-volume[82621]: INFO cinder.volume.manager [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Deleted volume successfully. Apr 13 14:24:09 devstack cinder-volume[82621]: DEBUG cinder.coordination [None req-fcd4535d-0eb8-476e-ab9a-e92a3c995ce0 tempest-CinderUnicodeTest-1041780885 None] Lock "cinder-03daf9d2-958d-47f3-b2ef-03092436c671-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=82621) __release /opt/stack/cinder/cinder/coordination.py:152}}